Praful932
/

dolphin-2.2.1-mistral-7b-samsum-ft-v1-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

dolphin-2.2.1-mistral-7b-samsum-ft-v1-GPTQ / config.json

Commit History

Update config.json

9d63892
verified

Praful932 commited on Jan 21

update config.json for transformers GPTQ support

821ec26
verified

Praful932 commited on Jan 21

Upload of AutoGPTQ quantized model

6dbea96
verified

Praful932 commited on Jan 21