Edit Models filters

Inference status

Misc

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

5

Full-text search

Active filters: autogptq

hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 47.5k • 17

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 39.7k • 19

ldilov/stablelm-tuned-alpha-7b-4bit-128g-descact-sym-true-sequential

Text Generation • Updated Nov 28, 2023 • 20

flozi00/OpenAssistant-falcon-40B-4-bits-autogptq

Text Generation • Updated Oct 6, 2023 • 15 • 2

hugging-quants/Meta-Llama-3.1-405B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 17.4k • 16