Edit Models filters

Model Tree

Qwen/Qwen2-0.5B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

49

Full-text search

Active filters: Qwen/Qwen2-0.5B-Instruct

PrunaAI/Qwen-Qwen2-0.5B-Instruct-bnb-4bit-smashed

Text Generation • Updated Jul 14 • 29

PrunaAI/Qwen-Qwen2-0.5B-Instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 14 • 7

TrentJohnsongtri/Qwen2-0.5B-Instruct-Q2_K-GGUF

Text Generation • Updated Jul 26 • 7

TrentJohnsongtri/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 26 • 6

Morgen0052/Qwen2-0.5B-Instruct-Q4_0-GGUF

Text Generation • Updated Jul 30 • 12

Georgia47/Qwen2-0.5B-Instruct-Q4_0-GGUF

Text Generation • Updated Jul 31 • 54

lapp0/distily_experiments_loss_reverse_kl

Updated Aug 6 • 4

lapp0/distily_experiments_loss_kl

Updated Aug 7 • 4

lapp0/distily_experiments_loss_mse

Updated Aug 6 • 4

lapp0/distily_experiments_loss_cakld

Updated Aug 7 • 7

Felladrin/gguf-q5_k_m-imat-qwen2-0.5b-instruct

Text Generation • Updated Aug 14 • 7

dlhaojin/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 18 • 6

mlc-ai/Qwen2-0.5B-Instruct-q4f16_0-MLC

Updated Aug 23 • 136

Ffftdtd5dtft/Qwen2-0.5B-Instruct-IQ1_S-GGUF

Text Generation • Updated Sep 4 • 15

TitanML/Qwen2-0.5B-Instruct-AWQ

Text Generation • Updated Sep 11 • 1

Elaine5/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 30 • 22

eoe/Qwen2-0.5B-Instruct-Q2_K-GGUF

Text Generation • Updated 6 days ago • 24

eoe/Qwen2-0.5B-Instruct-Q4_0-GGUF

Text Generation • Updated 6 days ago • 25

tensorblock/Qwen2-0.5B-Instruct-GGUF

Text Generation • Updated 1 day ago • 217