Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ktoprakucar
/
Hermes-3-Llama-3.1-8B-Q8-GPTQ
like
2
English
llama
Llama-3
instruct
finetune
chatml
synthetic data
distillation
function calling
json mode
axolotl
roleplaying
chat
8-bit precision
gptq
License:
llama3
Model card
Files
Files and versions
Community
Train
70b320d
Hermes-3-Llama-3.1-8B-Q8-GPTQ
1 contributor
History:
2 commits
ktoprakucar
AutoGPTQ model for NousResearch/Hermes-3-Llama-3.1-8B: 8bits, gr128, desc_act=True
70b320d
verified
2 months ago
.gitattributes
1.52 kB
initial commit
2 months ago
config.json
1.19 kB
AutoGPTQ model for NousResearch/Hermes-3-Llama-3.1-8B: 8bits, gr128, desc_act=True
2 months ago
gptq_model-8bit-128g.safetensors
9.25 GB
LFS
AutoGPTQ model for NousResearch/Hermes-3-Llama-3.1-8B: 8bits, gr128, desc_act=True
2 months ago
quantize_config.json
265 Bytes
AutoGPTQ model for NousResearch/Hermes-3-Llama-3.1-8B: 8bits, gr128, desc_act=True
2 months ago