Transformers
GGUF
English
yi
sft
Yi-34B-200K

No Newlines in responses

#5
by AbeStinkin - opened

I’ve tried the new instruct template and stop token fix, but nothing I do seems to fix the lack of newlines in my responses.

Is anyone else seeing this issue? I’m not seeing it commented on the original, non quant, model either.

I’m using oobabooga, but have tested it a few ways.

Yeah I'm having the same issue.

Please try downloading the GGUF file(s) again.

This problem was caused by a temporary workaround fix to the metadata of the GGUFs, to solve a different problem. That has now been undone, and the newly updated files (uploaded earlier today) should solve that newline issue in text-generation-webui.

Thank you! Works great now!

Sign up or log in to comment