-
-
-
-
-
-
Inference status
Active filters:
int8
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8
Text Generation
•
Updated
•
12.1k
•
11
Intel/distilbart-cnn-12-6-int8-dynamic-inc
Text2Text Generation
•
Updated
•
23
•
2
SamLowe/roberta-base-go_emotions-onnx
Text Classification
•
Updated
•
2.83k
•
15
avans06/madlad400-7b-mt-bt-ct2-int8_float16
Updated
•
21
•
2
ecastera/eva-dolphin-llama3-8b-spanish
Text Generation
•
Updated
•
24
•
3
model-scope/glm-4-9b-chat-GPTQ-Int8
Text Generation
•
Updated
•
16
•
2
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation
•
Updated
•
9.27k
•
11
neuralmagic/gemma-2-9b-it-quantized.w8a8
Text Generation
•
Updated
•
219
•
2
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8
Text Generation
•
Updated
•
870
•
2
Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-static-inc
Text Classification
•
Updated
•
127
•
5
Intel/bert-base-uncased-mrpc-int8-qat-inc
Text Classification
•
Updated
•
21
•
1
Intel/albert-base-v2-sst2-int8-static-inc
Text Classification
•
Updated
•
20
Intel/bert-base-uncased-finetuned-swag-int8-static-inc
Multiple Choice
•
Updated
•
7
•
1
Intel/bert-base-uncased-mrpc-int8-static-inc
Text Classification
•
Updated
•
28
Intel/distilbert-base-uncased-finetuned-conll03-english-int8-static-inc
Token Classification
•
Updated
•
7
•
1
Intel/camembert-base-mrpc-int8-dynamic-inc
Text Classification
•
Updated
•
21
Intel/bert-base-uncased-mrpc-int8-dynamic-inc
Text Classification
•
Updated
•
18
Intel/roberta-base-mrpc-int8-static-inc
Text Classification
•
Updated
•
17
Intel/bart-large-mrpc-int8-dynamic-inc
Text Classification
•
Updated
•
19
Intel/xlnet-base-cased-mrpc-int8-static-inc
Text Classification
•
Updated
•
16
Intel/electra-small-discriminator-mrpc-int8-static-inc
Text Classification
•
Updated
•
17
echarlaix/distilbert-sst2-inc-dynamic-quantization-magnitude-pruning-0.1
Text Classification
•
Updated
•
14
Intel/MiniLM-L12-H384-uncased-mrpc-int8-static-inc
Text Classification
•
Updated
•
22
Intel/MiniLM-L12-H384-uncased-mrpc-int8-qat-inc
Text Classification
•
Updated
•
22
Intel/distilbert-base-cased-distilled-squad-int8-static-inc
Question Answering
•
Updated
•
21
Intel/bert-base-uncased-squad-int8-static-inc
Question Answering
•
Updated
•
16
•
1
echarlaix/t5-small-int8-dynamic
Translation
•
Updated
•
13
•
4
echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic
Text Classification
•
Updated
•
2.57k
•
1
Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc
Text Classification
•
Updated
•
42
•
1
Intel/distilbert-base-uncased-distilled-squad-int8-static-inc
Question Answering
•
Updated
•
2.54k
•
4