Hugging Face's logo

catid
/
cat-llama-3-70b-awq-q256-w4-gemm

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card Files Community
cat-llama-3-70b-awq-q256-w4-gemm
File size: 135 Bytes 
8a611a0
 
 
 
1
2
3
4
 
version https://git-lfs.github.com/spec/v1
oid sha256:58649d7aef5c838e7c0990c3244e7f66b3cc9f8a0fc0a95d956837f190b02134
size 4918047360