Skip to content

Commit b5370c4

Browse files
committed
Updated docs.
1 parent 3043c3b commit b5370c4

File tree

2 files changed

+11
-6
lines changed

2 files changed

+11
-6
lines changed

docs/source/user_guide/large_language_model/langchain_models.rst

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -33,9 +33,9 @@ By default, the integration uses the same authentication method configured with
3333
llm = ChatOCIModelDeployment(
3434
model="odsc-llm",
3535
endpoint= f"https://modeldeployment.oci.customer-oci.com/<OCID>/predict",
36-
# Optionally you can specify additional keyword arguments for the model, e.g. temperature and headers.
36+
# Optionally you can specify additional keyword arguments for the model, e.g. temperature and default_headers.
3737
temperature=0.1,
38-
headers={"route": "v1/chat/completions"}, # default header for chat models
38+
default_headers={"route": "v1/chat/completions"}, # default route for chat models
3939
)
4040
4141
Alternatively, you may use specific authentication for the model:
@@ -50,9 +50,9 @@ Alternatively, you may use specific authentication for the model:
5050
endpoint= f"https://modeldeployment.oci.customer-oci.com/<OCID>/predict",
5151
# Use security token authentication for the model
5252
auth=ads.auth.security_token(profile="my_profile"),
53-
# Optionally you can specify additional keyword arguments for the model, e.g. temperature and headers.
53+
# Optionally you can specify additional keyword arguments for the model, e.g. temperature and default_headers.
5454
temperature=0.1,
55-
headers={"route": "v1/chat/completions"}, # default header for chat models
55+
default_headers={"route": "v1/chat/completions"}, # default route for chat models
5656
)
5757
5858
Completion Models
@@ -69,7 +69,7 @@ Completion models takes a text string and input and returns a string with comple
6969
endpoint= f"https://modeldeployment.oci.customer-oci.com/<OCID>/predict",
7070
# Optionally you can specify additional keyword arguments for the model.
7171
max_tokens=32,
72-
headers={"route": "v1/completions"}, # default header for completion models
72+
default_headers={"route": "v1/completions"}, # default route for completion models
7373
)
7474
7575
# Invoke the LLM. The completion will be a string.
@@ -102,7 +102,7 @@ Chat models takes `chat messages <https://python.langchain.com/docs/concepts/#me
102102
endpoint=f"<oci_model_deployment_url>/predict",
103103
# Optionally you can specify additional keyword arguments for the model.
104104
max_tokens=32,
105-
headers={"route": "v1/chat/completions"}, # default header for chat models
105+
default_headers={"route": "v1/chat/completions"}, # default route for chat models
106106
)
107107
108108
messages = [

docs/source/user_guide/model_registration/large_language_model.rst

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,11 @@
22
Large Language Model
33
====================
44

5+
.. admonition:: AI Quick Actions
6+
:class: note
7+
8+
Oracle Data Science now has launched `AI Quick Actions <https://docs.oracle.com/en-us/iaas/data-science/using/ai-quick-actions.htm>`_, which makes it easy for you to browse foundation models, and deploy, fine-tune, and evaluate them inside Data Science notebooks.
9+
510
Oracle ADS (Accelerated Data Science) opens the gateway to harnessing the full potential of the Large Language models
611
within Oracle Cloud Infrastructure (OCI). `Meta <https://ai.meta.com/resources/models-and-libraries/llama-downloads/>`_'s
712
latest offering, `Llama 2 <https://ai.meta.com/llama/>`_, introduces a collection of pre-trained and

0 commit comments

Comments
 (0)