How to run without gpu

[DL909]

I downloaded the docker on. Ubuntu 22 nd run it using

docker run -it         --name fish-speech-test         -p 7860:7860         fishaudio/fish-speech:latest-dev         zsh

(I deleted the -gpu all parameters since I have no gpu on this Ubuntu)
and then I run

export GRADIO_SERVER_NAME="0.0.0.0"
python tools/webui.py

I wait for a while, and I got such output

2024-09-21 02:57:13.859 | INFO     | __main__:<module>:484 - Loading Llama model...
/opt/fish-speech/fish_speech/models/text2semantic/llama.py:371: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
  weights = torch.load(
Exception in thread Thread-2 (worker):
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/threading.py", line 1075, in _bootstrap_inner
    self.run()
  File "/usr/local/lib/python3.12/threading.py", line 1012, in run
    self._target(*self._args, **self._kwargs)
  File "/opt/fish-speech/tools/llama/generate.py", line 573, in worker
    model, decode_one_token = load_model(
                              ^^^^^^^^^^^
  File "/opt/fish-speech/tools/llama/generate.py", line 359, in load_model
    model = model.to(device=device, dtype=precision)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1174, in to
    return self._apply(convert)
           ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/torch/nn/modules/module.py", line 780, in _apply
    module._apply(fn)
  File "/usr/local/lib/python3.12/site-packages/torch/nn/modules/module.py", line 805, in _apply
    param_applied = fn(param)
                    ^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1160, in convert
    return t.to(
           ^^^^^
  File "/usr/local/lib/python3.12/site-packages/torch/cuda/__init__.py", line 314, in _lazy_init
    torch._C._cuda_init()
RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx

meanwhile, I can't access to localhost:7860. I believe this means the loading has failed. So I'm wondering if there is a way to use cpu only.

[DL909]

Oh, I have solved this problem. Just add --device cpu parameter after webui.py