HuggingFace model with Langgraph

[astudzinski]

I want to build local Langgraph solution that works with HuggingFace model stored in my local file system. All tutorials use openAI model. Does it means that langgraph works only with public models and cannot work work with other LLMs?

[eyurtsev]

LangGraph is just a run time for code that involves cycles. It can work with any LLM, and it can work without ANY LLMs. It all depends on which application you're building.

If you are building an application that requires using tools, then you should use a chat model that supports tool calling!

Please read this: https://python.langchain.com/v0.2/docs/how_to/tool_calling/

You can also add ad-hoc support for tool calling for models that do not support tool calling natively https://python.langchain.com/v0.2/docs/how_to/tools_prompting/