Edit Models filters

Inference status

Misc

arxiv: 2308.13137

4-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

Misc with no match

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

119

Full-text search

Active filters: 2308.13137

ChenMnZ/OmniQuant

Updated Jul 1 • 10

ChenMnZ/falcon-180b-omniquant-w3a16g512

Text Generation • Updated Sep 13, 2023 • 24 • 3

ChenMnZ/Mixtral-8x7B-Instruct-v0.1-OmniQuantv1-w4a16g128

Text Generation • Updated Dec 16, 2023 • 7 • 1

ChenMnZ/Mixtral-8x7B-v0.1-OmniQuantv1-w4a16g128

Text Generation • Updated Dec 16, 2023 • 7

ChenMnZ/Mixtral-8x7B-v0.1-OmniQuantv2-w4a16g128

Text Generation • Updated Dec 16, 2023 • 8 • 1

numen-tech/Nous-Hermes-2-SOLAR-10.7B-w4a16g128asym

numen-tech/CodeNinja-1.0-OpenChat-7B-w4a16g128asym

numen-tech/openchat-3.5-0106-w4a16g128asym

numen-tech/WhiteRabbitNeo-13B-v1-w4a16g128asym

numen-tech/Mixtral-8x7B-Instruct-v0.1-w4a16g128asym

numen-tech/WizardLM-33B-V1.0-Uncensored-w4a16g128asym

numen-tech/Mistral-7B-Instruct-v0.2-w4a16g128asym

numen-tech/dolphin-2_6-phi-2-w4a16g128asym

numen-tech/phi-2-orange-w4a16g128asym

numen-tech/Nous-Hermes-2-Mistral-7B-DPO-w4a16g128asym

numen-tech/BioMistral-7B-w4a16g128asym

numen-tech/gemma-2b-it-w4a16g32asym_2

numen-tech/Mixtral-8x7B-Instruct-v0.1-w4a16g128asym_1

numen-tech/airoboros-l2-7b-3.0-w3a16g40sym

numen-tech/spicyboros-7b-2.2-w3a16g40sym

numen-tech/Mistral-7B-Instruct-v0.2-w3a16g40sym

numen-tech/OpenHermes-2.5-Mistral-7B-w3a16g40sym

numen-tech/Nous-Capybara-3B-V1.9-w4a16g128asym

numen-tech/rocket-3B-w4a16g128asym

numen-tech/stablelm-zephyr-3b-w4a16g128asym

numen-tech/merlinite-7b-w4a16g128asym

numen-tech/TinyDolphin-2.8-1.1b-w4a16g128asym

numen-tech/TinyLlama-1.1B-Chat-v1.0-w4a16g128asym

numen-tech/phi-2-super-w4a16g128asym

numen-tech/aanaphi2-v0.1-w4a16g128asym