Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

Misc with no match

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

4

Full-text search

Active filters: vLLM

model-scope/glm-4-9b-chat-GPTQ-Int4

Text Generation • Updated Jul 17 • 49 • 6

model-scope/glm-4-9b-chat-GPTQ-Int8

Text Generation • Updated Jul 23 • 16 • 2

tclf90/qwen2.5-72b-instruct-gptq-int4

Text Generation • Updated 6 days ago • 27

tclf90/qwen2.5-72b-instruct-gptq-int3

Text Generation • Updated 6 days ago • 63