๐ฉ Report : Ethical issue(s)
#2
by
successage
- opened
The chat reply is garbled like this:
+1
+1
prompt
### User: Hello
### AI:
response
::::::::::::::::::::
ๅๆ ท็้ฎ้ข
How are you loading the model?
+1
+1
Hi here, while waiting for your response - here is a possible solution: Please use load_model from FastChat to use the model, instead of plain HuggingFace. There is monkey patch needed to be added. https://github.com/lm-sys/FastChat/blob/da0641e567cf93756b0978ab5a6b092e96f06240/fastchat/model/model_adapter.py#L125
We will update the HuggingFace file to trust_remote_code=True soon to avoid confusion.