Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
AutoTrain Compatible
Inference Endpoints
nm-vllm
text-generation-inference
4-bit precision
custom_code
Misc with no match
Eval Results
Merge
text-embeddings-inference
8-bit precision
Carbon Emissions
Mixture of Experts
Apply filters
Models
18
Full-text search
Edit filters
Sort: Trending
Active filters:
nm-vllm
Clear all
neuralmagic/TinyLlama-1.1B-Chat-v1.0-pruned2.4
Text Generation
•
Updated
Mar 5
•
7
neuralmagic/MiniChat-2-3B-pruned2.4
Text Generation
•
Updated
Mar 5
•
7
neuralmagic/OpenHermes-2.5-Mistral-7B-pruned2.4
Text Generation
•
Updated
Mar 5
•
252
neuralmagic/OpenHermes-2.5-Mistral-7B-pruned50
Text Generation
•
Updated
Mar 5
•
285
•
1
neuralmagic/Nous-Hermes-2-SOLAR-10.7B-pruned2.4
Text Generation
•
Updated
Mar 5
•
7
neuralmagic/Nous-Hermes-2-Yi-34B-pruned2.4
Text Generation
•
Updated
Mar 5
•
10
neuralmagic/Nous-Hermes-2-Yi-34B-pruned50
Text Generation
•
Updated
Mar 5
•
6
neuralmagic/zephyr-7b-beta-marlin
Text Generation
•
Updated
Mar 6
•
8.36k
•
1
neuralmagic/llama2.c-stories110M-pruned2.4
Text Generation
•
Updated
Mar 5
•
11
neuralmagic/llama2.c-stories110M-pruned50
Text Generation
•
Updated
Mar 5
•
723
neuralmagic/phi-2-pruned50
Text Generation
•
Updated
Mar 5
•
9
neuralmagic/TinyLlama-1.1B-Chat-v1.0-marlin
Text Generation
•
Updated
Mar 6
•
4.8k
•
1
neuralmagic/OpenHermes-2.5-Mistral-7B-marlin
Text Generation
•
Updated
Mar 6
•
374
•
2
neuralmagic/Nous-Hermes-2-Yi-34B-marlin
Text Generation
•
Updated
Mar 6
•
4
•
5
softmax/Llama-2-70b-chat-hf-marlin
Text Generation
•
Updated
Mar 17
•
2.74k
softmax/falcon-180B-chat-marlin
Text Generation
•
Updated
Mar 21
•
6
dtransposed/llama2.c-stories110M-pruned50-compressed-tensors
Text Generation
•
Updated
Apr 23
•
4
nm-testing/llama2.c-stories110M-pruned50-compressed-tensors
Text Generation
•
Updated
Apr 25
•
5