Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Misc with no match

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

55

Full-text search

Active filters: 7-bit

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-7.0bpw-8hb-exl2

Text Generation • Updated 25 days ago • 27 • 1

Dracones/Merged-RP-Stew-V2-34B_exl2_7.0bpw

Text Generation • Updated Apr 11 • 1

Dracones/c4ai-command-r-v01_exl2_7.0bpw

Text Generation • Updated Apr 12 • 4

Dracones/c4ai-command-r-v01_exl2_7.0bpw-rpcal

Text Generation • Updated Apr 12 • 5

Dracones/miqu-1-70b-sf_exl2_7.0bpw

Text Generation • Updated Apr 11 • 4

Dracones/c4ai-command-r-plus_exl2_7.0bpw

Text Generation • Updated Apr 13 • 6

Dracones/mixtral-8x22b-instruct-oh_exl2_7.0bpw

Text Generation • Updated Apr 14 • 6

bdambrosio/dbrx-instruct-7.0bpw-h8-exl2

Text Generation • Updated Apr 15 • 12

Dracones/WizardLM-2-8x22B_exl2_7.0bpw

Text Generation • Updated Apr 16 • 12

Dracones/CodeQwen1.5-7B-Chat_exl2_7.0bpw

Text Generation • Updated Apr 16

Dracones/CodeQwen1.5-7B_exl2_7.0bpw

Text Generation • Updated Apr 16 • 2

Kotokin/Meta-Llama-3-8B-hf-exl2-7bpw

Text Generation • Updated Apr 18

Dracones/Llama-3-Lumimaid-70B-v0.1_exl2_7.0bpw

Text Generation • Updated May 4 • 2

FuturisticVibes/Coomand-R-35B-v1-7.0bpw-h8-exl2

Text Generation • Updated May 12 • 6

FuturisticVibes/L3-Arcania-4x8b-7.0bpw-h8-exl2

Text Generation • Updated May 14 • 2

SicariusSicariiStuff/CalderaAI_Foredoomed-9B_EXL-7.0

Text Generation • Updated May 18 • 7 • 1

BigHuggyD/jukofyork_miquplus-midnight-70b_exl2_7.0bpw

Text Generation • Updated Jun 6 • 5

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_7.0bpw_h8

Text Generation • Updated Jun 19 • 15

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_RP_Soup_EXL2_7.0bpw

Text Generation • Updated Jun 23 • 8

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_7.0bpw

Text Generation • Updated Jun 23 • 7

BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_7.0bpw_h8

Text Generation • Updated Jun 25 • 2

BigHuggyD/alpindale_magnum-72b-v1_exl2_7.0bpw_h8

Text Generation • Updated Jun 26

BigHuggyD/cohereforai_c4ai-command-r-plus_exl2_7.0bpw_h8

Text Generation • Updated Jun 28 • 2

bigstorm/Hermes-2-Theta-Llama-3-70B-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18 • 2

bigstorm/Qwen2-72B-Instruct-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18 • 2

bigstorm/firefunction-v2-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18 • 9

bigstorm/Llama-3-Groq-70B-Tool-Use-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18 • 6

DrNicefellow/Mistral-Nemo-Instruct-2407-exl2-7bpw-h8

Text Generation • Updated Jul 18 • 6

bigstorm/Meta-Llama-3.1-70B-Instruct-7.0bpw-8hb-exl2

Text Generation • Updated Jul 24 • 9

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_7.0bpw_h8

Text Generation • Updated Aug 14 • 2