Text Generation
Transformers
PyTorch
Safetensors
English
llama
conversational
text-generation-inference
Inference Endpoints

awq versions

#4
by KnutJaegersberg - opened

Hey @TheBloke will you quantize those?

hamishivi changed discussion status to closed

Sign up or log in to comment