what is MODEL_PROMPT_TEMPLATE of YI-34B-Chat ?

#3
by zzzzzxx - opened

i use "{{#each messages}}{{#ifUser}}[INST] {{#if @first }}{{#if @root .preprompt}}{{@root.preprompt}}\n{{/if}}{{/if}} {{content}} [/INST]{{/ifUser}}{{#ifAssistant}}{{content}} {{/ifAssistant}}{{/each}}" in default directory ,but it is wrong

01-ai org

It's ChatML format, you can find it in our github repo or tokenizer_config.json
https://github.com/01-ai/Yi#31-use-the-chat-model

<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

As it seems like your question has been answered, if there is nothing else we can help you with on this matter, we will be closing this discussion for now.

If you have any further questions, feel free to reopen this discussion or start a new one.

Thank you for your contribution to this community!

richardllin changed discussion status to closed

Sign up or log in to comment