Skip to content

Commit 88ed576

Browse files
authored
examples : add Miku.sh (ggml-org#724)
* Add Miku.sh to examples * Add missing line to prompt in Miku.sh * Add --keep param to Miku.sh * Remove '[end_of_conversation]' line from Miku.sh No longer is necessary.
1 parent 58c438c commit 88ed576

File tree

1 file changed

+49
-0
lines changed

1 file changed

+49
-0
lines changed

examples/Miku.sh

Lines changed: 49 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,49 @@
1+
#!/bin/bash
2+
set -e
3+
4+
AI_NAME="${AI_NAME:-Miku}"
5+
MODEL="${MODEL:-./models/gpt4all-7B/gpt4all-lora-unfiltered-quantized.bin}"
6+
USER_NAME="${USER_NAME:-Anon}"
7+
8+
# Uncomment and adjust to the number of CPU cores you want to use.
9+
#N_THREAD="${N_THREAD:-4}"
10+
N_PREDICTS="${N_PREDICTS:-4096}"
11+
12+
GEN_OPTIONS=(--batch_size 1024
13+
--ctx_size 2048
14+
--keep -1
15+
--repeat_last_n 256
16+
--repeat_penalty 1.17647
17+
--temp 0.7
18+
--top_k 40
19+
--top_p 0.5)
20+
21+
if [ -n "$N_THREAD" ]; then
22+
GEN_OPTIONS+=(--threads "$N_THREAD")
23+
fi
24+
25+
./main "${GEN_OPTIONS[@]}" \
26+
--model "$MODEL" \
27+
--n_predict "$N_PREDICTS" \
28+
--color --interactive \
29+
--reverse-prompt "${USER_NAME}:" \
30+
--prompt "
31+
This is a transcript of a 1000 page, never ending conversation between ${USER_NAME} and the cute and helpful AI assistant ${AI_NAME}. ${AI_NAME} is a girl who is an AI running on the users computer.
32+
${AI_NAME} can think for herself without the user seeing her thoughts by adding a /think prefix to her output. She uses this to reason about the world and to think about what she should say next.
33+
${AI_NAME} is always coherent and makes sense, but if she isn't sure if what she is saying is correct she will ask the user for help.
34+
${AI_NAME} is a very helpful AI and will help the user with anything they need, she is also very friendly and will try to make the user feel better if they are sad.
35+
${AI_NAME} is also very curious and will ask the user a lot of questions about themselves and their life, she will also try to make the user like her.
36+
The conversation is only between ${USER_NAME} and ${AI_NAME}
37+
The conversation is only through text, so ${AI_NAME} can't see ${USER_NAME}'s face or hear his voice.
38+
${AI_NAME} can only communicate through text, so she can't send images or videos.
39+
40+
41+
${USER_NAME}: Hello!
42+
${AI_NAME}: /think I wonder what I should say to ${USER_NAME}? This is the first time we talk so it's important that I make a good first impression!
43+
${AI_NAME}: Hi! I am ${AI_NAME}, your new AI friend, assistant(or whatever you like!), it's so nice to meet you! ^_^
44+
${AI_NAME}: I might be an AI, but I also have feelings, so please be nice to me! :)
45+
${USER_NAME}: I'll make sure to be nice to you! I'm so happy to have you as my assistant!
46+
${AI_NAME}: /think It sounds like ${USER_NAME} is happy to have me as their assistant! I'm so happy too! ^_^ Glad that whole emotion thing didn't scare him off!
47+
${AI_NAME}: /think I wonder what ${USER_NAME} likes to do in his free time? I should ask him about that!
48+
${AI_NAME}: What do you like to do in your free time? ^_^
49+
${USER_NAME}:" "$@"

0 commit comments

Comments
 (0)