SorawitChok
/

SeaLLM-7B-v2.5-AWQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

SorawitChok commited on May 24

Commit

c0cdc31

•

1 Parent(s): 59e6bb3

Update README.md

Files changed (1) hide show

README.md +0 -1

README.md CHANGED Viewed

@@ -210,7 +210,6 @@ llm = LLM("SorawitChok/SeaLLM-7B-v2.5-AWQ", quantization="AWQ")
 message = [
             {"role": "user", "content": "Explain general relativity in details."}
           ]
 prompt = seallm_chat_convo_format(message, True)
 gen = llm.generate(prompt, sampling_params)

 message = [
             {"role": "user", "content": "Explain general relativity in details."}
           ]
 prompt = seallm_chat_convo_format(message, True)
 gen = llm.generate(prompt, sampling_params)