Openllm调用GLM
#45
by
cat13
- opened
ValueError: Loading /home/ps/bentoml/models/pt-thudm-chatglm2-6b/0ecfe0b857efd00836a4851b3dd2ed04bd4b197f requires you to execute the modeling file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option trust_remote_code=True to remove this error. 我在代码中设置了trust_remote_code=True
llm = OpenLLM(
model_name="chatglm",
model_id="thudm/chatglm2-6b",
temperature=0.94,
repetition_penalty=1.2,
trust_remote_code=True,
)