Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3.1-Nemotron-70B-Instruct-HF-GGUF
like
3
Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
2
Use this model
8493fcd
Llama-3.1-Nemotron-70B-Instruct-HF-GGUF
1 contributor
History:
5 commits
MaziyarPanahi
8290aa30e76af0d4174280b7d3520af3099ba0a28d95fb7c8b93833e6552b137
8493fcd
verified
29 days ago
.gitattributes
1.85 kB
8290aa30e76af0d4174280b7d3520af3099ba0a28d95fb7c8b93833e6552b137
29 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ1_M.gguf
16.8 GB
LFS
31df1e70e8b3ec8d2c555e7897589623835f42f45edfcbd7cb8cd61668ba65ca
29 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ1_S.gguf
15.3 GB
LFS
70e8dede3e457b0c6ab9ebb4e06206acbbda6abe492655819086aedea2cbdff3
29 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ2_XS.gguf
21.1 GB
LFS
616e029fae21693286630bb7c2cdb0037f73323e24b3f9496a4bd086a4dcdfd3
29 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ3_XS.gguf
29.3 GB
LFS
8290aa30e76af0d4174280b7d3520af3099ba0a28d95fb7c8b93833e6552b137
29 days ago
