How to use system prompt without interactive mode?

[Naozumi520]

I've seen few question in discussion about system prompt but no information about using system prompt with just a single question, just like the official openai

[ghost]

I dunno what openai's implementation is like. What's stopping you from using a system prompt with a single question?

I guess you're talking about llama2 chat models, yeah?

[Naozumi520]

Yeah. However, when I set the prompt, it always enter the interactive mode.

[ghost]

Show your main? ./main ect..

[shi-kejian]

<s>[INST] <<SYS>>
{{ system_prompt }}
<</SYS>>

{{ user_message }} [/INST]

According to https://huggingface.co/blog/llama2#how-to-prompt-llama-2

I guess you could just leave the {{system_prompt}} empty?

[goerch]

I've seen few question in discussion about system prompt but no information about using system prompt with just a single question, just like the official openai

Yeah, main is pretty complicated. It would be nice to have some simple text-completion and chat-completion modes.