Edit Models filters

Model Tree

meta-llama/Llama-3.1-405B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

26

Full-text search

Active filters: meta-llama/Llama-3.1-405B-Instruct

meta-llama/Llama-3.1-405B-Instruct-FP8

Text Generation • Updated Sep 25 • 70.5k • 175

neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8

Text Generation • Updated Oct 9 • 2.53k • 31

neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8-dynamic

Text Generation • Updated 27 days ago • 332 • 14

MaziyarPanahi/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • Updated Jul 29 • 148k • 12

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16

Text Generation • Updated Oct 10 • 2.79k • 12

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8

Text Generation • Updated Oct 10 • 891 • 2

amd/Meta-Llama-3.1-405B-Instruct-FP8-KV

Updated Oct 7 • 9.33k • 3

VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-1024-woft

Updated Oct 13 • 13 • 1

VPTQ-community/Meta-Llama-3.1-405B-Instruct-v8-k4096-0-woft

Updated Oct 13 • 4 • 1

VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-64-woft

Updated Oct 13 • 44 • 3

VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k32768-32768-woft

Updated Oct 13 • 11 • 1

VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-128-woft

Updated Oct 13 • 3 • 1

VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-256-woft

Updated Oct 13 • 8 • 1

VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-65536-woft

Updated Oct 13 • 11 • 3

xmadai/Llama-3.1-405B-Instruct-xMADai-INT4

Text Generation • Updated 17 days ago • 918 • 6

VPTQ-community/Meta-Llama-3.1-405B-Instruct-v8-k65536-256-woft

Updated 25 days ago • 19 • 1

mlx-community/Llama-3.1-405B-Instruct-8bit

Text Generation • Updated 9 days ago • 43 • 1

mlx-community/Meta-Llama-3.1-405B-Instruct-8bit

Text Generation • Updated 5 days ago • 90 • 1

hugging-quants/Meta-Llama-3.1-405B-Instruct-BNB-NF4

Text Generation • Updated Sep 16 • 1.15k • 5

nisten/meta-405b-instruct-cpu-optimized-gguf

Updated Jul 24 • 931 • 39

etemiz/Llama-3.1-405B-Inst-GGUF

Updated Oct 7 • 229 • 3

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9 • 583 • 2

jburmeister/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • Updated Aug 22 • 15

VoyagerYuan/Xillama-3.1-405B-Instruct-BNB-NF4-BF16

Updated Sep 3 • 8

VPTQ-community/Meta-Llama-3.1-405B-Instruct-v8-k65536-65536-woft

Updated 25 days ago • 39

IntuitIntel/Llama-3.1-405B-Instruct-8bit

Text Generation • Updated 9 days ago • 14