What prompt template?

#2
by sdalemorrey - opened

I have no idea what prompt template you're using or what settings. It's just repeating the system and user prompts endlessly when using standard llama template.

Mind sharing?

same here, it cant use standard llama template.

Knowledge Engineering Group (KEG) & Data Mining at Tsinghua University org

[INST]{query1}[/INST]{response1}[INST]{query2}[/INST]{response2}...

Actually, I originally said that wasn't working for me, then realized my issue. That does seem to work. Thanks so much!

sdalemorrey changed discussion status to closed

Sign up or log in to comment