Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

3,211

Full-text search

Active filters: mixtral

LoneStriker/Mixtral-Fusion-4x7B-Instruct-v0.1-3.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 1

LoneStriker/Mixtral-Fusion-4x7B-Instruct-v0.1-4.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 3

LoneStriker/Toppy-Mix-4x7B-4.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 1

LoneStriker/Mixtral-Fusion-4x7B-Instruct-v0.1-5.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 2

LoneStriker/Toppy-Mix-4x7B-5.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 1

LoneStriker/Mixtral-Fusion-4x7B-Instruct-v0.1-6.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 1

LoneStriker/Mixtral-SlimOrca-8x7B-2.4bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 11

LoneStriker/Mixtral-Fusion-4x7B-Instruct-v0.1-8.0bpw-h8-exl2-2

Text Generation • Updated Dec 17, 2023 • 1

LoneStriker/dolphin-2.5-mixtral-8x7b-2.4bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 9 • 2

LoneStriker/Toppy-Mix-4x7B-8.0bpw-h8-exl2-2

Text Generation • Updated Dec 17, 2023 • 3

LoneStriker/Mixtral-SlimOrca-8x7B-3.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 10

LoneStriker/dolphin-2.5-mixtral-8x7b-3.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 3

LoneStriker/dolphin-2.5-mixtral-8x7b-3.5bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 9 • 8

LoneStriker/dolphin-2.5-mixtral-8x7b-4.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 8 • 1

LoneStriker/Mixtral-SlimOrca-8x7B-4.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 8

LoneStriker/dolphin-2.5-mixtral-8x7b-5.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 5 • 3

LoneStriker/Mixtral-SlimOrca-8x7B-5.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 8

LoneStriker/dolphin-2.5-mixtral-8x7b-6.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 12 • 6

LoneStriker/Mixtral-SlimOrca-8x7B-6.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 7

LoneStriker/Mixtral-8x7B-MoE-Undi95-RP-Story-3.5bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 7

LoneStriker/Mixtral-SlimOrca-8x7B-3.5bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 8

TheBloke/Mixtral-Fusion-4x7B-Instruct-v0.1-GPTQ

Text Generation • Updated Dec 17, 2023 • 11 • 2

TheBloke/Mixtral-Fusion-4x7B-Instruct-v0.1-GGUF

Updated Dec 17, 2023 • 101 • 8

LoneStriker/Mixtral-8x7B-v0.1-2.4bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 11

TheBloke/BigPlap-8x20B-GGUF

Updated Dec 17, 2023 • 11 • 8

LoneStriker/Mixtral-8x7B-v0.1-3.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 11

LoneStriker/Toppy-Mix-4x7B-6.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 4

LoneStriker/Mixtral-8x7B-v0.1-3.5bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 11

TheBloke/PiVoT-MoE-GGUF

Updated Dec 17, 2023 • 80 • 9

TheBloke/PiVoT-MoE-GPTQ

Text Generation • Updated Dec 17, 2023 • 10 • 1