Skip to content

Commit 3ccb9dc

Browse files
committed
added new notebook
:
1 parent b142a6f commit 3ccb9dc

File tree

1 file changed

+50
-0
lines changed

1 file changed

+50
-0
lines changed
Lines changed: 50 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,50 @@
1+
{
2+
"cells": [
3+
{
4+
"cell_type": "markdown",
5+
"metadata": {},
6+
"source": []
7+
},
8+
{
9+
"cell_type": "markdown",
10+
"metadata": {},
11+
"source": []
12+
},
13+
{
14+
"cell_type": "markdown",
15+
"metadata": {},
16+
"source": [
17+
"# Model Output Evaluation Project Setup\n",
18+
"\n",
19+
"This notebook will provide an example workflow of setting up a Model Output Evaluation (MOE) Project with the Labelbox-Python SDK.\n",
20+
"MOE Projects are set up differently then other editors with it's own unique methods and modifications to existing methods:\n",
21+
"\n",
22+
"- `create_model_evaluation_project`: Main method used to create a chat model evaluation project\n",
23+
"\n",
24+
"- `create_ontology`: Methods used to create Labelbox ontologies for MOE project this requires a `ontology_kind` parameter set to `lb.OntologyKind.ModelEvaluation`\n",
25+
"\n",
26+
"- `create_ontology_from_feature_schemas`: Similar to `create_ontology` but from a list of `feature schema ids` which is designed to allow you to use existing features instead of creating new features. This also requires a `ontology_kind` set to `lb.OntologyKind.ModelEvaluation`."
27+
]
28+
},
29+
{
30+
"cell_type": "code",
31+
"execution_count": null,
32+
"metadata": {
33+
"vscode": {
34+
"languageId": "plaintext"
35+
}
36+
},
37+
"outputs": [],
38+
"source": [
39+
"## Setup"
40+
]
41+
}
42+
],
43+
"metadata": {
44+
"language_info": {
45+
"name": "python"
46+
}
47+
},
48+
"nbformat": 4,
49+
"nbformat_minor": 2
50+
}

0 commit comments

Comments
 (0)