How to change the number of threads?

[iamashwin99]

By default docker compuse up runs with 4 threads:

....
flowise-api-1      |                  from binding.cpp:1:
flowise-api-1      | go-llama/llama.cpp/llama.h:162:49: note: declared here
flowise-api-1      |   162 |     LLAMA_API DEPRECATED(struct llama_context * llama_init_from_file(
flowise-api-1      |       |                                                 ^~~~~~~~~~~~~~~~~~~~
flowise-api-1      | go-llama/llama.cpp/llama.h:30:36: note: in definition of macro 'DEPRECATED'
flowise-api-1      |    30 | #    define DEPRECATED(func, hint) func __attribute__((deprecated(hint)))
flowise-api-1      |       |                                    ^~~~
flowise-api-1      | Starting LocalAI using 4 threads, with models path: /models

....

Is there a way to specify more threads? I dont see anything in the yaml file.

[iamashwin99]

Its defined in the .env. See for eg https://github.com/go-skynet/LocalAI/blob/f3063f98d3d9bc2053095bcc5580be592d3db6f4/.env#L3