File tree Expand file tree Collapse file tree 1 file changed +2
-2
lines changed Expand file tree Collapse file tree 1 file changed +2
-2
lines changed Original file line number Diff line number Diff line change @@ -10,8 +10,8 @@ Proof of concept:
10
10
11
11
``` sh
12
12
export model_name=llama_3.2-1b && export quantization=f32
13
- ./build/bin/finetune --file wikitext-2-raw/wiki.test.raw -ngl 999 --model models/${model_name} -${quantization} .gguf -c 512 -b 512 -ub 512
14
- ./build/bin/perplexity --file wikitext-2-raw/wiki.test.raw -ngl 999 --model finetuned-model.gguf
13
+ ./build/bin/llama- finetune --file wikitext-2-raw/wiki.test.raw -ngl 999 --model models/${model_name} -${quantization} .gguf -c 512 -b 512 -ub 512
14
+ ./build/bin/llama- perplexity --file wikitext-2-raw/wiki.test.raw -ngl 999 --model finetuned-model.gguf
15
15
```
16
16
17
17
The perplexity value of the finetuned model should be lower after training on the test set for 2 epochs.
You can’t perform that action at this time.
0 commit comments