You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/README.md
+17-21Lines changed: 17 additions & 21 deletions
Original file line number
Diff line number
Diff line change
@@ -4,10 +4,11 @@ description: Learn how to leverage Open Source AI
4
4
logo: images/ibm-blue-background.png
5
5
---
6
6
7
-
## Open Source AI workshop
7
+
## Open Source AI Workshop
8
8
9
-
Welcome to the Open Source AI workshop! Thank you for trusting us to help you learn about this
10
-
new and exciting space. In this workshop, you'll gain the skills and confidence to effectively use LLMs locally through simple exercises and experimentation, and learn best practices for leveraging open source AI.
9
+
You've probably heard how tools like ChatGPT are changing workflows — but when it comes to privacy, security, and control, using public AI tools isn't always an option. In this hands-on workshop, you'll learn how to run your own local, open-source LLMs — no cloud, no cost, and no compromise.
10
+
11
+
We'll walk through installing and running models with tools like ollama, AnythingLLM, and Continue using familiar environments like VS Code. By the end, you'll have a fully functional local AI assistant, ready to support your work securely and offline.
11
12
12
13
Our overarching goals of this workshop is as follows:
13
14
@@ -16,31 +17,25 @@ Our overarching goals of this workshop is as follows:
16
17
* Learn about Prompt Engineering and how to leverage a local LLM in daily tasks.
17
18
18
19
!!! tip
19
-
This workshop may seem short, but a lot of working with AI is exploration and engagement.
20
-
These labs is set up for you to get "everything you need to start" put together so you
21
-
can share in a collaborative learning environment and shared exploration. Don't hesitate
22
-
to raise your hand ask questions and engage with the other students.
23
-
24
-
By the time you leave today, you'll have everything you need leverage this on your laptop
25
-
at home, without internet access, in a secure manner.
20
+
working with AI is all about exploration and hands-on engagement. These labs are designed to give you everything you need to get started — so you can collaborate, experiment, and learn together. Don’t hesitate to ask questions, raise your hand, and connect with other participants.
26
21
27
22
## Agenda
28
23
29
24
| Lab | Description |
30
25
| :--- | :--- |
31
-
|[Lab 0: Pre-work](pre-work/README.md)| Install pre-requisites for the workshop |
26
+
|[Lab 0: Workshop Pre-work](pre-work/README.md)| Install pre-requisites for the workshop |
32
27
|[Lab 1: Configuring AnythingLLM](lab-1/README.md)| Set up AnythingLLM to start using an LLM locally |
33
-
|[Lab 2: Using the local LLM](lab-2/README.md)| Test some general prompt templates |
description: Steps to configure Open-WebUI for usage
3
+
description: Set up Open-WebUI to start using an LLM locally
4
4
logo: images/ibm-blue-background.png
5
5
---
6
6
7
-
!!! warning
8
-
This is **optional**. You don't need Open-WebUI if you have AnythingLLM already running.
7
+
Let's start by configuring [Open-WebUI](../pre-work/README.md#installing-open-webui) and `ollama` to talk to one another. The following screenshots will be from a Mac, but this should be similar on Windows and Linux.
9
8
10
-
Now that you have [Open-WebUI installed](../pre-work/README.md#installing-open-webui) let's configure it with `ollama` and Open-WebUI to talk to one another. The following screenshots will be from a Mac, but the gist of this should be the same on Windows and Linux.
11
-
12
-
Open up Open-WebUI (assuming you've run `open-webui serve` and nothing else), and you should see something like the following:
If you see something similar, Open-WebUI is installed correctly! Continue on, if not, please find a workshop TA or raise your hand for some help.
17
-
18
-
Before clicking the *Getting Started* button, make sure that `ollama` has `granite3.1-dense` downloaded:
9
+
First, if you haven't already, download the Granite 3.1 model. Make sure that `ollama` is running in the background (you may have to run `ollama serve` in its own terminal depending on how you installed it) and in another terminal run the following command:
19
10
20
11
```bash
21
12
ollama pull granite3.1-dense:8b
22
13
```
23
14
24
15
!!! note
25
-
The download may take a few minutes depending on your internet connection. In the meantime, you can check out information about model we're using [here](https://ollama.com/library/granite3.1-dense). Check out how many languages it supports and take note of its capabilities. It'll help you decide what tasks you might want to use it for.
16
+
The download may take a few minutes depending on your internet connection. In the meantime, you can check out information about model we're using [here](https://ollama.com/library/granite3.1-dense). Check out how many languages it supports and take note of its capabilities. It'll help you decide what tasks you might want to use it for in the future.
17
+
18
+
Open up Open-WebUI (assuming you've run `open-webui serve`):
If you see something similar, Open-WebUI is installed correctly! Continue on, if not, please find a workshop TA or raise your hand for some help.
26
23
27
24
Click *Getting Started*. Fill out the next screen and click the *Create Admin Account*. This will be your login for your local machine. Remember that this because it will be your Open-WebUI configuration login information if want to dig deeper into it after this workshop.
28
25
@@ -41,4 +38,4 @@ The first response may take a minute to process. This is because `ollama` is spi
41
38
42
39
You may notice that your answer is slighty different then the screen shot above. This is expected and nothing to worry about!
43
40
44
-
**Congratulations!** Now you have Open-WebUI running and it's configured to work with `granite3.1-dense` and `ollama`. Have a quick chat with your model before moving on to the next lab!
41
+
**Congratulations!** Now you have Open-WebUI running and it's configured to work with `granite3.1-dense` and `ollama`. Move on to the next lab and have a chat with your model!
Copy file name to clipboardExpand all lines: docs/lab-1/README.md
+7-7Lines changed: 7 additions & 7 deletions
Original file line number
Diff line number
Diff line change
@@ -1,25 +1,25 @@
1
1
---
2
2
title: Configuring AnythingLLM
3
-
description: Steps to configure AnythingLLM for usage
3
+
description: Set up AnythingLLM to start using an LLM locally
4
4
logo: images/ibm-blue-background.png
5
5
---
6
6
7
-
Now that you've got[AnythingLLM installed](../pre-work/README.md#anythingllm), we need to configure it with `ollama`. The following screenshots are taken from a Mac, but the gist of this should be the same on Windows and Linux.
7
+
Let's start by configuring[AnythingLLM installed](../pre-work/README.md#anythingllm) and `ollama` to talk to one another. The following screenshots will be from a Mac, but this should be similar on Windows and Linux.
8
8
9
-
First, if you haven't already, download the Granite 3.1 model. Open up a terminal and run the following command:
9
+
First, if you haven't already, download the Granite 3.1 model. Make sure that `ollama` is running in the background (you may have to run `ollama serve` in its own terminal depending on how you installed it) and in another terminal run the following command:
10
10
11
11
```bash
12
12
ollama pull granite3.1-dense:8b
13
13
```
14
14
15
15
!!! note
16
-
The download may take a few minutes depending on your internet connection. In the meantime, you can check out information about model we're using [here](https://ollama.com/library/granite3.1-dense). Check out how many languages it supports and take note of its capabilities. It'll help you decide what tasks you might want to use it for.
16
+
The download may take a few minutes depending on your internet connection. In the meantime, you can check out information about model we're using [here](https://ollama.com/library/granite3.1-dense). Check out how many languages it supports and take note of its capabilities. It'll help you decide what tasks you might want to use it for in the future.
17
17
18
-
Either click on the *Get Started* button or open up settings (the 🔧 button). For now, we are going to configure the global settings for `ollama` but you can always change it in the future.
18
+
Open the AnythingLLM desktop application and either click on the *Get Started* button or open up settings (the 🔧 button). For now, we are going to configure the global settings for `ollama` but you can always change it in the future.
Click on the *LLM* section, and select **Ollama** as the LLM Provider. Select the `granite3-dense:8b` model you downloaded. You'd be able to see all the models you have access to through `ollama` here.
22
+
Click on the *LLM* section, and select **Ollama** as the LLM Provider. Select the `granite3.1-dense:8b` model you downloaded. You'd be able to see all the models you have access to through `ollama` here.
@@ -41,4 +41,4 @@ The first response may take a minute to process. This is because `ollama` is spi
41
41
42
42
You may notice that your answer is slighty different then the screen shot above. This is expected and nothing to worry about!
43
43
44
-
**Congratulations!** Now you have AnythingLLM running and it's configured to work with `granite3.1-dense` and `ollama`. Have a quick chat with your model before moving on to the next lab!
44
+
**Congratulations!** Now you have AnythingLLM running and it's configured to work with `granite3.1-dense` and `ollama`. Move on to the next lab and have a chat with your model!
0 commit comments