Request: Other LLMs

[estiens]

I can take a crack at a PR here even though I'm not nec a pythonista - it owuld be nice to sub in other LLM providers or locallly running LLMs

[johnuopini]

Also being able to use Claude would be nice, Claude Sonnet is 20 times cheaper

[genevera]

I just submitted a pr to allow for arbitrary openai api compatible endpoints to be used. #30