We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 78f6cec commit b1f6d21Copy full SHA for b1f6d21
README.md
@@ -90,6 +90,18 @@ python3 -m bulk_chain.infer \
90
--api_token "<REPLICATE-API-TOKEN>"
91
```
92
93
+Or, you can launch **demo mode** to interact with LLM via command line:
94
+> **NOTE:** Demo supports streaming!
95
+```bash
96
+python3 -m bulk_chain.demo \
97
+ --schema "test/schema/thor_cot_schema.json" \
98
+ --adapter "dynamic:replicate_104.py:Replicate" \
99
+ %%m \
100
+ --model_name "meta/meta-llama-3-70b-instruct" \
101
+ --api_token "<REPLICATE-API-TOKEN>" \
102
+ --stream
103
+```
104
+
105
# Embed your LLM
106
107
All you have to do is to implement `BaseLM` class, that includes:
0 commit comments