|
16 | 16 | "metadata": {}, |
17 | 17 | "source": [ |
18 | 18 | "<td>\n", |
19 | | - "<a href=\"https://colab.research.google.com/github/Labelbox/labelbox-python/blob/develop/examples/project_configuration/live_multimodal_chat_project.ipynb\" target=\"_blank\"><img\n", |
| 19 | + "<a href=\"https://colab.research.google.com/github/Labelbox/labelbox-python/blob/develop/examples/project_configuration/multimodal_chat_project.ipynb\" target=\"_blank\"><img\n", |
20 | 20 | "src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"></a>\n", |
21 | 21 | "</td>\n", |
22 | 22 | "\n", |
23 | 23 | "<td>\n", |
24 | | - "<a href=\"https://github.com/Labelbox/labelbox-python/tree/develop/examples/project_configuration/live_multimodal_chat_project.ipynb\" target=\"_blank\"><img\n", |
| 24 | + "<a href=\"https://github.com/Labelbox/labelbox-python/tree/develop/examples/project_configuration/multimodal_chat_project.ipynb\" target=\"_blank\"><img\n", |
25 | 25 | "src=\"https://img.shields.io/badge/GitHub-100000?logo=github&logoColor=white\" alt=\"GitHub\"></a>\n", |
26 | 26 | "</td>" |
27 | 27 | ], |
|
30 | 30 | { |
31 | 31 | "metadata": {}, |
32 | 32 | "source": [ |
33 | | - "# Live Multimodal Chat project setup\n", |
| 33 | + "# Multimodal chat project setup\n", |
34 | 34 | "\n", |
35 | | - "This notebook will provide an example workflow of setting up a Live Multimodal Chat (LMC) Project with the Labelbox-Python SDK.\n", |
36 | | - "Live Multimodal Chat Projects are set up differently than other projects with its own unique method and modifications to existing methods:\n", |
| 35 | + "This notebook will provide an example workflow of setting up a multimodal Chat (MMC) Project with the Labelbox-Python SDK.\n", |
| 36 | + "Multimodal Chat Projects are set up differently than other projects with its own unique method and modifications to existing methods:\n", |
37 | 37 | "\n", |
38 | | - "- `client.create_model_evaluation_project`: The main method used to create a Live Multimodal Chat project\n", |
| 38 | + "- `client.create_model_evaluation_project`: The main method used to create a live multimodal Chat project.\n", |
| 39 | + " \n", |
| 40 | + "- `client.create_offline_model_evaluation_project`: The main method used to create a offline multimodal Chat project.\n", |
39 | 41 | "\n", |
40 | | - "- `client.create_ontology`: Methods used to create Labelbox ontologies for LMC project this requires an `ontology_kind` parameter set to `lb.OntologyKind.ModelEvaluation`\n", |
| 42 | + "- `client.create_ontology`: Methods used to create Labelbox ontologies for LMC project this requires an `ontology_kind` parameter set to `lb.OntologyKind.ModelEvaluation`.\n", |
41 | 43 | "\n", |
42 | 44 | "- `client.create_ontology_from_feature_schemas`: Similar to `client.create_ontology` but from a list of `feature schema ids` designed to allow you to use existing features instead of creating new features. This also requires an `ontology_kind` set to `lb.OntologyKind.ModelEvaluation`." |
43 | 45 | ], |
|
68 | 70 | "metadata": {}, |
69 | 71 | "source": [ |
70 | 72 | "## API key and client\n", |
71 | | - "Provide a valid API key below in order to properly connect to the Labelbox client. Please review [Create API key guide](https://docs.labelbox.com/reference/create-api-key) for more information." |
| 73 | + "Please provide a valid API key below to connect to the Labelbox client properly. For more information, please review the [Create API key guide](https://docs.labelbox.com/reference/create-api-key)." |
72 | 74 | ], |
73 | 75 | "cell_type": "markdown" |
74 | 76 | }, |
|
82 | 84 | { |
83 | 85 | "metadata": {}, |
84 | 86 | "source": [ |
85 | | - "## Example: Create Live Multimodal Chat project\n", |
| 87 | + "## Example: Create multimodal Chat project\n", |
86 | 88 | "\n", |
87 | | - "The steps to creating a Live Multimodal Chat Project through the Labelbox-Python SDK are similar to creating a regular project. However, they vary slightly, and we will showcase the different methods in this example workflow." |
| 89 | + "The steps to creating a multimodal Chat Projects through the Labelbox-Python SDK are similar to creating a regular project. However, they vary slightly, and we will showcase the different methods in this example workflow." |
88 | 90 | ], |
89 | 91 | "cell_type": "markdown" |
90 | 92 | }, |
91 | 93 | { |
92 | 94 | "metadata": {}, |
93 | 95 | "source": [ |
94 | | - "### Create a Live Multimodal Chat ontology\n", |
| 96 | + "### Create a multimodal chat ontology\n", |
95 | 97 | "\n", |
96 | | - "You can create ontologies for Model Evaluation projects the same way as creating ontologies for other projects with the only requirement of passing in a `ontology_kind` parameter which needs set to `lb.OntologyKind.ModelEvaluation`. You can create ontologies with two methods: `client.create_ontology` and `client.create_ontology_from_feature_schemas`." |
| 98 | + "You can create ontologies for multimodal chat projects in the same way as other project ontologies using two methods: `client.create_ontology` and `client.create_ontology_from_feature_schemas`. The only additional requirement is to pass an ontology_kind parameter, which needs to be set to `lb.OntologyKind.ModelEvaluation`." |
97 | 99 | ], |
98 | 100 | "cell_type": "markdown" |
99 | 101 | }, |
|
102 | 104 | "source": [ |
103 | 105 | "#### Option A: `client.create_ontology`\n", |
104 | 106 | "\n", |
105 | | - "Typically, you create ontologies and generate the associated features at the same time. Below is an example of creating an ontology for your Live Multimodal Chat project using supported tools and classifications. For information on supported annotation types visit our [Live Multimodal Chat](https://docs.labelbox.com/docs/live-multimodal-chat#supported-annotation-types) guide." |
| 107 | + "Typically, you create ontologies and generate the associated features simultaneously. Below is an example of creating an ontology for your multimodal chat project using supported tools and classifications; for information on supported annotation types, visit our [multimodal chat evaluation guide](https://docs.labelbox.com/docs/multimodal-chat#supported-annotation-types) guide." |
106 | 108 | ], |
107 | 109 | "cell_type": "markdown" |
108 | 110 | }, |
|
128 | 130 | "outputs": [], |
129 | 131 | "execution_count": null |
130 | 132 | }, |
| 133 | + { |
| 134 | + "metadata": {}, |
| 135 | + "source": [ |
| 136 | + "## Creating multimodal chat evaluation projects\n", |
| 137 | + "\n", |
| 138 | + "There are two versions of a multimodal chat evaluation projects:\n", |
| 139 | + "\n", |
| 140 | + "1. Offline multimodal chat evaluation projects: Data rows will need to be imported manually and have no live model invocation.\n", |
| 141 | + "\n", |
| 142 | + "2. Live multimodal chat evaluation projects: Empty data rows are generated on project creation and are filled out with live model invocation.\n", |
| 143 | + "\n", |
| 144 | + "We will discuss creating both types of projects with the Labelbox SDK." |
| 145 | + ], |
| 146 | + "cell_type": "markdown" |
| 147 | + }, |
| 148 | + { |
| 149 | + "metadata": {}, |
| 150 | + "source": [ |
| 151 | + "## Set up offline multimodal chat evaluation project\n", |
| 152 | + "\n", |
| 153 | + "For an offline multimodal chat evaluation project, you must import conversational version 2 data rows. For more information, please visit our [import multimodal chat evaluation data](https://docs.labelbox.com/reference/import-multimodal-chat-data) guide. Offline multimodal chat evaluation projects are created through the SDK with `client.create_offline_model_evaluation_project`. This method uses the same parameters as `client.create_project` but provides better validation to ensure the project is set up correctly." |
| 154 | + ], |
| 155 | + "cell_type": "markdown" |
| 156 | + }, |
| 157 | + { |
| 158 | + "metadata": {}, |
| 159 | + "source": "project = client.create_offline_model_evaluation_project(\n name=\"<project_name>\",\n description=\"<project_description>\", # optional\n)", |
| 160 | + "cell_type": "code", |
| 161 | + "outputs": [], |
| 162 | + "execution_count": null |
| 163 | + }, |
131 | 164 | { |
132 | 165 | "metadata": {}, |
133 | 166 | "source": [ |
|
224 | 257 | { |
225 | 258 | "metadata": {}, |
226 | 259 | "source": [ |
227 | | - "**To finish setting up your LMC project, you will need to navigate to your project overview inside the Labelbox platform and select _Complete setup_ on the left side panel**" |
| 260 | + "### Mark project setup as completed\n", |
| 261 | + "\n", |
| 262 | + "Once you have finalized your project and set up your model configs, you must mark the project setup as completed.\n", |
| 263 | + "\n", |
| 264 | + "**Once the project is marked as \"setup complete\", a user can not add, modify, or delete existing project model configs.**" |
228 | 265 | ], |
229 | 266 | "cell_type": "markdown" |
230 | 267 | }, |
| 268 | + { |
| 269 | + "metadata": {}, |
| 270 | + "source": "project.set_project_model_setup_complete()", |
| 271 | + "cell_type": "code", |
| 272 | + "outputs": [], |
| 273 | + "execution_count": null |
| 274 | + }, |
231 | 275 | { |
232 | 276 | "metadata": {}, |
233 | 277 | "source": [ |
|
0 commit comments