1 contributor

History: 18 commits

MaziyarPanahi

907797f952e6f222bd6736c71da95add21423af790573aa20f5d3b9b04348db5

4914a5d verified 28 days ago

.gitattributes

3.81 kB

907797f952e6f222bd6736c71da95add21423af790573aa20f5d3b9b04348db5 28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ1_M.gguf

16.8 GB
LFS

[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1) 28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ1_S.gguf

15.3 GB
LFS

[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1) 28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ2_XS.gguf

21.1 GB
LFS

[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1) 28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ3_XS.gguf

29.3 GB
LFS

[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1) 28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ4_XS.gguf

37.9 GB
LFS

[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1) 28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q2_K.gguf

26.4 GB
LFS

[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1) 28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q3_K_L.gguf

37.1 GB
LFS

[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1) 28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q3_K_M.gguf

34.3 GB
LFS

[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1) 28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q3_K_S.gguf

30.9 GB
LFS

[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1) 28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q4_K_M.gguf

42.5 GB
LFS

[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1) 28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q4_K_S.gguf

40.3 GB
LFS

[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1) 28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q5_K_M.gguf

49.9 GB
LFS

[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1) 28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q5_K_S.gguf

48.7 GB
LFS

[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1) 28 days ago
Mistral-Small-Instruct-2409-GGUF_imatrix.dat

11.9 MB
LFS

907797f952e6f222bd6736c71da95add21423af790573aa20f5d3b9b04348db5 28 days ago
Mistral-Small-Instruct-2409.IQ1_M.gguf

5.27 GB
LFS

d97ea4a1d42c3368b208cf06cec623e9f5fb03938a279c38612d1acde7244a27 28 days ago
Mistral-Small-Instruct-2409.IQ1_S.gguf

4.83 GB
LFS

07314d8a2b5323b9d045348b779f0f5c93de26113e9320c6a2c92a80725521ac 28 days ago
Mistral-Small-Instruct-2409.IQ2_XS.gguf

6.65 GB
LFS

4325ec2cd0579937e24513e09138db858b55a686e157f87f163f9ec0797ebefe 28 days ago
Mistral-Small-Instruct-2409.IQ3_XS.gguf

9.18 GB
LFS

c27c599ce30688e70283a911239259359932f5e4c2bfce54c4267fb92906764b 28 days ago
Mistral-Small-Instruct-2409.IQ4_XS.gguf

11.9 GB
LFS

038dbb9704e27e05422b0e62878c4cba5cc4bcf528c1c3ef6e2170de97836f79 28 days ago
Mistral-Small-Instruct-2409.Q2_K.gguf

8.27 GB
LFS

09c69d43845de7bc4d3f1bbb8910d69b03b2444e206c2a086ca7b8b28e406038 28 days ago
Mistral-Small-Instruct-2409.Q3_K_L.gguf

11.7 GB
LFS

d59c868477712071137f1d10f3aeac4411d8bdc386437159bffb1e377c8b2402 28 days ago
Mistral-Small-Instruct-2409.Q3_K_M.gguf

10.8 GB
LFS

f2de7ffd39aec8dddf94b1b9c86f45f93b738fff04db543ca05c64ce4ef1af44 28 days ago
Mistral-Small-Instruct-2409.Q3_K_S.gguf

9.64 GB
LFS

72058eebd438f4bc08ee3197c32530097a37e5db2fe8eb29dd3e0b283ed81117 28 days ago
Mistral-Small-Instruct-2409.Q4_K_M.gguf

13.3 GB
LFS

8690d7a32304278be77265f5e545764276b5ea5e42338cef35ae46bb1808d0ac 28 days ago
Mistral-Small-Instruct-2409.Q4_K_S.gguf

12.7 GB
LFS

43c4c03e63f03f320b5c319adbe9d22673fb4731b88e3eb34c3fbf71d604b5b6 28 days ago
Mistral-Small-Instruct-2409.Q5_K_M.gguf

15.7 GB
LFS

e4d076c506c9ff0d713a316209d4031be46387e5687bbd6ef0489e9d05dd29b4 28 days ago
Mistral-Small-Instruct-2409.Q5_K_S.gguf

15.3 GB
LFS

d133f4fd86e7d8452b2b226b1e753a8f9b42d3c4d2753b44fd03e1701660a7c3 28 days ago
Mistral-Small-Instruct-2409.Q6_K.gguf

18.3 GB
LFS

f16f70c3113e86a025e87e792028f8ec80c6a909ecbcf0d090c0d535cff39b59 28 days ago
Mistral-Small-Instruct-2409.Q8_0.gguf

23.6 GB
LFS

a7adc8824d32bab8aaac7cd4240b665218a36001e62491637265db20bc94f685 28 days ago
README.md

3.06 kB

907797f952e6f222bd6736c71da95add21423af790573aa20f5d3b9b04348db5 28 days ago