Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ENOT-AutoDL
/
gpt-j-6B-tensorrt-int8
like
7
Follow
ENOT AutoDL
11
Text Generation
Transformers
ONNX
lambada
English
text-generation-inference
causal-lm
int8
tensorrt
ENOT-AutoDL
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
74702df
gpt-j-6B-tensorrt-int8
3 contributors
History:
4 commits
ivkalgin
added 4090 engine
74702df
over 1 year ago
.gitattributes
Safe
1.52 kB
added engine for rtx3080ti
over 1 year ago
NVIDIA_GeForce_RTX_3080_Ti-8_5_3_1-i8f32.engine
Safe
8.5 GB
LFS
normalized engine name
over 1 year ago
NVIDIA_GeForce_RTX_4090-8_5_3_1-i8f32.engine
Safe
8.5 GB
LFS
added 4090 engine
over 1 year ago