Setting up an environment for Langchain development with TGI Containers

[penard-monkey]

I'm working on a langchain project and I want to get it up and running locally. I was hoping to get TGI container running in Docker on my Mac Studio but I guess TGI doesn't support the metal framework?

I'm switching from OllamaLLM to HuggingFaceEndpoints and I have a HUGE dataset. I don't want to run a large dedicated endpoint until I have it set up correctly. I don't really mind if things take a long time to process during development.

Any thoughts on getting an environment set up with HuggingFaceEndpoints without me spinning up a dedicated endpoint for development?