pip install -r requirements.txt
python service.py
or
fastapi run service.py
The app can be configured via pydantic-settings. See here
Setting | Description | Default |
---|---|---|
log_level | log level | INFO |
template_path | Path to otogpt template | habitat_template_v2.yaml |
llm_model | LLM model to use | ollama/mistral |
TODO: Document/Configure how to use bioportal api key
For develop, you can run it in dev mode which automatically reload changes
fastapi dev service.py