Train-text-from-scratch with CPU(Mac PC RAM32)

[taotaotao3]

segmentation fault happens now.

What I did is the following

git clone https://github.com/ggerganov/llama.cpp.git  
cd llama.cpp. 
LLAMA_METAL=1 make. 
cd models. 
wget "https://huggingface.co/TheBloke/Llama-2-7B-chat-GGML/resolve/main/llama-2-7b-chat.ggmlv3.q4_0.bin". 
cd ..  
(transzoom) user@usernoMacBook-Pro llama.cpp % ./train-text-from-scratch \
        --vocab-model ../models/llama-2-7b-chat.ggmlv3.q4_0.bin \
        --ctx 64 --embd 256 --head 8 --layer 16 \
        --checkpoint-in  chk-shakespeare-256x16.gguf \
        --checkpoint-out chk-shakespeare-256x16.gguf \
        --model-out ggml-shakespeare-256x16-f32.gguf \
        --train-data "shakespeare.txt" \
        -t 6 -b 16 --seed 1 --adam-iter 256. 
main: seed: 1. 
llama.cpp: loading model from ../models/llama-2-7b-chat.ggmlv3.q4_0.bin. 
zsh: segmentation fault  ./train-text-from-scratch --vocab-model  --ctx 64 --embd 256 --head 8 --layer. 

My concerning point is old model of llama2.

Please help me. Thanks for reading.

[taotaotao3]

Little a bit I got success. But why is a ggml-shakespeare-256x16-f32.bin 0 byte?

'''
used_mem_before_opt: 988356416 bytes
used_mem_after_opt: 1001418944 bytes
Generating 16 tokens.
iding that tongue that ever sweet,
Was used in giving gentle doom:
And taught it thus anew to greet:
'I hate' she altered with an end,
That followed it as gentle day,
Doth follow night who---
aoul a sad,
And not so much of the world is,
(transzoom) user@usernoMacBook-Pro train-text-from-scratch % ls
CMakeLists.txt chk-shakespeare-256x16.bin shakespeare.txt
README.md ggml-shakespeare-256x16-f32.bin train-text-from-scratch.cpp
(transzoom) user@usernoMacBook-Pro train-text-from-scratch % ls -l
total 1901048
-rw-r--r-- 1 user staff 259 8 31 21:38 CMakeLists.txt
-rw-r--r-- 1 user staff 692 8 31 21:38 README.md
-rw-r--r-- 1 user staff 960775756 9 1 09:34 chk-shakespeare-256x16.bin
-rw-r--r-- 1 user staff 0 9 1 09:34 ggml-shakespeare-256x16-f32.bin
-rw-r--r-- 1 user staff 94275 9 1 04:06 shakespeare.txt
-rw-r--r-- 1 user staff 147391 8 31 21:38 train-text-from-scratch.cpp
'''

[taotaotao3]

I'm sorry. I resolved that. That reason was that I didn't execute gguf exchanging from ggml. When I changed to gguf, I was able to do that.