Hugging Face's logo

MaziyarPanahi
/
Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card Files Community
2
MaziyarPanahi commited on
Commit
08861ce
•
1 Parent(s): 8261002

8690d7a32304278be77265f5e545764276b5ea5e42338cef35ae46bb1808d0ac

Browse files
Files changed (2) hide show
  1. .gitattributes +1 -0
  2. Mistral-Small-Instruct-2409.Q4_K_M.gguf +3 -0
.gitattributes CHANGED
@@ -55,3 +55,4 @@ Mistral-Small-Instruct-2409.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
55
  Mistral-Small-Instruct-2409.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
56
  Mistral-Small-Instruct-2409.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
  Mistral-Small-Instruct-2409.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 
 
55
  Mistral-Small-Instruct-2409.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
56
  Mistral-Small-Instruct-2409.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
  Mistral-Small-Instruct-2409.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Mistral-Small-Instruct-2409.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-Instruct-2409.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ebb16dd5fbc43503bda45718f460480e35c800b37bb9e1a4863c7b8acd0d6f7a
3
+ size 13341239424