What is the query template?
#2
by
doneforaiur
- opened
Is there a specfic template should I follow while doing inference? As in, the input should be something like this;
### Human: Merhaba.
### Assistant:
Please check this reference for further info:
https://www.philschmid.de/instruction-tune-llama-2
Thank you for the reference. Altough with mentioned structure the output was;
### Input: Aya ne zaman gidildi?
### Response: İnsanların çevresel gelişimdeki rolü hakkında bilinçli olmalarına yardımcı olmak için, çevresel gelişimdeki gelişimlerin ne zaman olduğunu özetleyin.
Which is not an answer but an another instruction. Played a bit with top_p and temperature to no avail. Tried "Develer neden susuz uzun süre yaşayabilir?", which is in the dataset hoping that it will get it right but nope. :')
Thanks for the feedback. It seems that the fine tuning with QLORA and Dolly15K Turkish dataset should be evaluated in detail.
How do I provide a text as context and ask questions about that text?