how i convert this nomic model

[kalle07]

nomic-ai/modernbert-embed-base

into gguf

is that possible ?
which branch which command?

[danbev]

I don't think ModernBertModel is supported yet by looking at the models in convert_hf_to_gguf.py.

[kalle07]

but it should be possible its allways done with another version

https://huggingface.co/nomic-ai/nomic-embed-text-v1.5-GGUF/tree/main

[danbev]

Those are converted from NomicBertModel and it looks like there are some differences between this and ModernBertMode, but they might just be the naming of configuration attributes.

You can try adding ModernBertMode to convert_hf_to_gguf.py:

@Model.register("NomicBertModel", "ModernBertModel")

And then clone the model:

$ git clone --branch main --single-branch --depth 1 https://huggingface.co/nomic-ai/modernbert-embed-base

And then run the conversion script:

$ ./convert_hf_to_gguf.py --verbose models/modernbert-embed-base --outfile models/modernbert-embed-f16.gguf
INFO:hf-to-gguf:Loading model: modernbert-embed-base
INFO:gguf.gguf_writer:gguf: This GGUF file is for Little Endian only
Traceback (most recent call last):
  File "/home/danbev/work/ai/llama.cpp/./convert_hf_to_gguf.py", line 5077, in <module>
    main()
  File "/home/danbev/work/ai/llama.cpp/./convert_hf_to_gguf.py", line 5057, in main
    model_instance = model_class(dir_model=dir_model, ftype=output_type, fname_out=fname_out,
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/danbev/work/ai/llama.cpp/./convert_hf_to_gguf.py", line 3029, in __init__
    assert self.hparams["activation_function"] == "swiglu"
           ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
KeyError: 'activation_function'

And then you might be able to figure out the differences between these model by looking.

[kalle07]

sounds complicate ^^

[danbev]

I took a quick look into this and it seems like there is more to this than simple property name changes. I've not used NomicBertModel before but if you open an issue others that have might able to help implement support for ModernBertModel.