Convert safetensors to ggml

[paulocoutinhox]

Hi,

How to convert safetensors to ggml?

Error when try use the convert.py:

python3 convert.py /Users/paulo/Developer/workspaces/python/stable-diffusion-webui/models/Stable-diffusion/dreamshaper_8Inpainting.safetensors --outfile dreamshaper_8Inpainting.bin
Loading model file /Users/paulo/Developer/workspaces/python/stable-diffusion-webui/models/Stable-diffusion/dreamshaper_8Inpainting.safetensors
Traceback (most recent call last):
  File "/Users/paulo/Developer/workspaces/cpp/ai-kit/extras/scripts/convert.py", line 1202, in <module>
    main()
  File "/Users/paulo/Developer/workspaces/cpp/ai-kit/extras/scripts/convert.py", line 1135, in main
    model_plus = load_some_model(args.model)
  File "/Users/paulo/Developer/workspaces/cpp/ai-kit/extras/scripts/convert.py", line 1054, in load_some_model
    models_plus.append(lazy_load_file(path))
  File "/Users/paulo/Developer/workspaces/cpp/ai-kit/extras/scripts/convert.py", line 746, in lazy_load_file
    return lazy_load_safetensors_file(fp, path)
  File "/Users/paulo/Developer/workspaces/cpp/ai-kit/extras/scripts/convert.py", line 725, in lazy_load_safetensors_file
    model = {name: convert(info) for (name, info) in header.items() if name != '__metadata__'}
  File "/Users/paulo/Developer/workspaces/cpp/ai-kit/extras/scripts/convert.py", line 725, in <dictcomp>
    model = {name: convert(info) for (name, info) in header.items() if name != '__metadata__'}
  File "/Users/paulo/Developer/workspaces/cpp/ai-kit/extras/scripts/convert.py", line 713, in convert
    data_type = SAFETENSORS_DATA_TYPES[info['dtype']]
KeyError: 'I64'

Thanks.

[KerfuffleV2]

llama.cpp doesn't support Stable Diffusion models. Apparently they have 64bit integer tensors, which the SafeTensors stuff in convert.py doesn't handle (because there are no supported models that use it).

See the list of supported models near the top of the main README. (There are also some supported models that don't use convert.py and require their own separate script for conversion.)