Support for llama3-groq-70b-8192-tool-use-preview in langchain tool calling

[shrikant14]

Checked other resources

• I added a very descriptive title to this question.
• I searched the LangChain documentation with the integrated search.
• I used the GitHub search to find a similar question and didn't find it.

Commit to Help

• I commit to help with one of those options 👆

Example Code

from langchain_core.runnables import RunnablePassthrough
from langchain_groq import ChatGroq

llm_model = ChatGroq(
    temperature=0,
    groq_api_key="GROQ_API_KEY",
    model_name="llama3-groq-70b-8192-tool-use-preview",
)
function_json = [
    {
        "type": "function",
        "function": {
            "name": "get_current_weather",
            "description": "Get the current weather in a given location",
            "parameters": {
                "type": "object",
                "properties": {
                    "location": {
                        "type": "string",
                        "description": "The city and state, e.g. San Francisco, CA",
                    },
                    "unit": {"type": "string", "enum": ["celsius", "fahrenheit"]},
                },
                "required": ["location"],
            },
        },
    }
]
few_shot_prompt=[]
llm_with_tools = llm_model.bind_tools(function_json)
chain = {"query": RunnablePassthrough()} | few_shot_prompt | llm_with_tools
response = chain.invoke("Show me weather in Austin?")

Description

I am trying to use new function calling models from Groq: llama3-groq-70b-8192-tool-use-preview and It's not working,

System Info

System Information

OS: Darwin
OS Version: Darwin Kernel Version 23.4.0: Wed Feb 21 21:45:49 PST 2024; root:xnu-10063.101.15~2/RELEASE_ARM64_T6020
Python Version: 3.9.16 | packaged by conda-forge | (main, Feb 1 2023, 21:38:11)
[Clang 14.0.6 ]

Package Information

langchain_core: 0.1.46
langchain: 0.1.12
langchain_community: 0.0.28
langsmith: 0.1.31
langchain_anthropic: 0.1.11
langchain_cohere: 0.1.4
langchain_fireworks: 0.1.1
langchain_google_vertexai: 1.0.2
langchain_groq: 0.1.3
langchain_mistralai: 0.0.5
langchain_openai: 0.0.8
langchain_text_splitters: 0.0.1

Packages not installed (Not Necessarily a Problem)

The following packages were not found:

langgraph
langserve

[cheike569]

Yes please! I need this too.

[emorling]

+1