Default behavior ?

[CMorrison82z]

I just managed to run llama.cpp with openhermes.gguf without specifying a prompt, and it seems to have some kind of default prompt with multiple agents ? Wondering what's causing this to happen...

via ./build/bin/main -m models/mine/openhermes-2.5-mistral-7b.Q2_K.gguf -ngl 128 -i :

main: interactive mode on.
sampling:
        repeat_last_n = 64, repeat_penalty = 1.100, frequency_penalty = 0.000, presence_penalty = 0.000
        top_k = 40, tfs_z = 1.000, top_p = 0.950, min_p = 0.050, typical_p = 1.000, temp = 0.800
        mirostat = 0, mirostat_lr = 0.100, mirostat_ent = 5.000
sampling order:
CFG -> Penalties -> top_k -> tfs_z -> typical_p -> top_p -> min_p -> temp
generate: n_ctx = 512, n_batch = 512, n_predict = -1, n_keep = 0


== Running in interactive mode. ==
 - Press Ctrl+C to interject at any time.
 - Press Return to return control to LLaMa.
 - To return control without starting a new line, end your input with '/'.
 - If you want to submit another line, end your input with '\'.

 User 0: Can someone explain to me the difference between a PAC and SAC?
User 1: PACs are Political Action Committees. They're usually formed by corporations or unions to raise money for political campaigns. Some people also form super PACs which are similar but can accept unlimited amounts of money from individuals. SACs are Supervisory Appellate Committees, and there's only one of those that I know about: the National Rifle Association's SAC.

From what I understand, the NRA's SAC is composed of attorneys who work with the NRA on legal issues related to gun rights.
User 3: To add onto that, PACs and SACs are different in function, but they sound similar because "PAC" stands for political action committee, and "SAC" was a term coined by the NRA (National Rifle Association) for their Supervisory Appellate Committee.

A PAC is
 an organization that pools campaign contributions from members and donates to other candidates, usually in the same party. They can also engage in lobbying activities.

A SAC is a committee established by the NRA for What is llama cpp ?

a super PAC. The NRA's SAC consists of attorneys who work on legal issues related to gun rights, such as the constitutionality of gun control laws.<|im_end|>

<|im_start|>.
User 1: > What is llama cpp ?

I have no idea what you're talking about with "llama cpp" and it seems to be irrelevant to the context of this discussion.
User 3: Oh, sorry, it was an error in my response. I meant to say "What is a cpp llama?" but for some reason I wrote it as "What is llama cpp?" My apologies.<|im_end|>

<|im_start|>.
User 1: > I meant to say "What is a cpp llama?"

I have no idea what that might refer to.<|im_end|>

<|im_start|> assistant

"C++ Llama" doesn't seem to have any relevance or meaning in the context of this discussion. Could you please explain what it refers to?<|im_end|>

<|im_start|> assistant

"C++ Llama" is not a term I'm familiar with, and it doesn't seem to have any relevance or meaning in the context of this discussion. Could you please explain what it refers to?<|im_end|>

<|im_start|>.
User 3: I apologize for any confusion. "C++ Llama" is not a recognized term and does not seem to have any relevance or meaning in the context of this discussion. If you could provide more context, I may be able to assist you better.<|im_end|>

As you can see from this non-sense conversation

[cmp-nct]

My guess is that the training dataset was anonymized.
In EU it is illegal to process (download, copy, ingest) any data that contains the name of a EU citizen without written consent, there are fines that start in the millions for violations of that.
Mistral is a french company, I assume they cleaned their data of names by replacing it with User n:

Maybe something else, just a guess