NyxKrage
/

llama3-42b-v0-imat-gguf

Inference Endpoints

Model card Files Files and versions Community

llama3-42b-v0-imat-gguf

1 contributor

History: 18 commits

NyxKrage's picture

Upload llama3-42b.Q3_K_L.gguf with huggingface_hub

ac7a6ea verified 7 months ago

.gitattributes

2.28 kB

Upload llama3-42b.Q3_K_L.gguf with huggingface_hub 7 months ago
README.md

261 Bytes

Create README.md 7 months ago
llama3-42b.IQ2_S.gguf

13.8 GB
LFS

Upload llama3-42b.IQ2_S.gguf with huggingface_hub 7 months ago
llama3-42b.IQ2_XS.gguf

13.1 GB
LFS

Upload llama3-42b.IQ2_XS.gguf with huggingface_hub 7 months ago
llama3-42b.IQ2_XXS.gguf

11.9 GB
LFS

Upload llama3-42b.IQ2_XXS.gguf with huggingface_hub 7 months ago
llama3-42b.IQ4_XS.gguf

23.3 GB
LFS

Upload llama3-42b.IQ4_XS.gguf with huggingface_hub 7 months ago
llama3-42b.Q2_K_S.gguf

15.1 GB
LFS

Upload llama3-42b.Q2_K_S.gguf with huggingface_hub 7 months ago
llama3-42b.Q3_K_L.gguf

22.8 GB
LFS

Upload llama3-42b.Q3_K_L.gguf with huggingface_hub 7 months ago
llama3-42b.Q3_K_M.gguf

21 GB
LFS

Upload llama3-42b.Q3_K_M.gguf with huggingface_hub 7 months ago
llama3-42b.Q3_K_S.gguf

19 GB
LFS

Upload llama3-42b.Q3_K_S.gguf with huggingface_hub 7 months ago
llama3-42b.Q4_K_M.gguf

26.1 GB
LFS

Upload llama3-42b.Q4_K_M.gguf with huggingface_hub 7 months ago
llama3-42b.Q4_K_S.gguf

24.7 GB
LFS

Upload llama3-42b.Q4_K_S.gguf with huggingface_hub 7 months ago
llama3-42b.Q5_K_M.gguf

30.6 GB
LFS

Upload llama3-42b.Q5_K_M.gguf with huggingface_hub 7 months ago
llama3-42b.Q5_K_S.gguf

29.8 GB
LFS

Upload llama3-42b.Q5_K_S.gguf with huggingface_hub 7 months ago
llama3-42b.imat

15 MB
LFS

Upload llama3-42b.imat with huggingface_hub 7 months ago