Exaone model lineage (mlx_lm.models.exaone)

[uogbuji]

A new family. Overheard some nice words about it and tried it, though it's not released. Need to (in venv) clone mlx-examples, then

cd llms; pip install .

Alas it doesn't seem very clever.

❯ python test/quick_check.py mlx-community/EXAONE-3.5-7.8B-Instruct-4bit
Fetching 10 files: 100%|██████████████████████████████████████████████| 10/10 [00:00<00:00, 37888.93it/s]
Model type: exaone
{
  "response": "Hello! I'm doing well, thank you for asking. How can I assist you today?"
}
 ======================================== Country extraction
[
    {
        "name": "Country",
        "continent": "Continent"
    }
]
 ======================================== Square root of 256, pt 1
{
"result": 16.0
}
 ======================================== Square root of 256, pt 2
The square root of 256 is 16.
 ======================================== Square root of 256, pt 3
{ "result": 16 }
 ======================================== Usain bolt

 ======================================== END CHECK