Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

8-bit precision

4-bit precision

Misc with no match

Carbon Emissions

Mixture of Experts

Models

238

Full-text search

Active filters: int8

Intel/roberta-base-squad2-int8-static-inc

Updated Mar 21 • 5 • 1

Intel/roberta-large-mnli-int8-static-inc

Text Classification • Updated Oct 6, 2023 • 21

Intel/vit-base-patch16-224-int8-static-inc

Image Classification • Updated Sep 6, 2022 • 127 • 1

Intel/t5-small-xsum-int8-dynamic-inc

Text2Text Generation • Updated Mar 21 • 2.53k • 1

Intel/t5-small-finetuned-cnn-news-int8-dynamic-inc

Text2Text Generation • Updated Oct 6, 2023 • 26

AlexKoff88/bert_nm_mnli_sparse_quantized_90

Text Classification • Updated Nov 25, 2022 • 21

echarlaix/vit-food101-int8

Image Classification • Updated Nov 22, 2022 • 9

Intel/t5-large-finetuned-xsum-cnn-int8-dynamic-inc

Text2Text Generation • Updated Mar 21 • 2

Intel/t5-base-cnn-dm-int8-dynamic-inc

Text2Text Generation • Updated Mar 21 • 4

Intel/bart-large-cnn-int8-dynamic-inc

Text2Text Generation • Updated Mar 22 • 8 • 1

Intel/roberta-base-mrpc-int8-dynamic-inc

Text Classification • Updated Dec 28, 2022 • 8

Intel/xlm-roberta-base-mrpc-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 9

Intel/albert-base-v2-sst2-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 13

Intel/MiniLM-L12-H384-uncased-mrpc-int8-dynamic-inc

Text Classification • Updated Dec 28, 2022 • 17

Intel/gpt-j-6B-int8-dynamic-inc

Text Generation • Updated Apr 19, 2023 • 45 • 16

Intel/gpt-j-6B-int8-static-inc

Text Generation • Updated Apr 19, 2023 • 49 • 9

DataAgent/llama-7b-alpaca-zh-20k

Updated Apr 8, 2023

ENOT-AutoDL/gpt-j-6B-tensorrt-int8

Text Generation • Updated Jun 8, 2023 • 7

Intel/gpt-j-6B-pytorch-int8-static-inc

Text Generation • Updated Jan 18 • 45

DataAgent/llama-7b-alpaca-zh-120k

Updated Apr 8, 2023 • 1

Intel/gpt-neox-japanese-2.7b-int8-inc

Text Generation • Updated Mar 21

michaelfeil/ct2fast-gpt-j-6b

Updated May 19, 2023 • 29 • 1

michaelfeil/ct2fast-pythia-12b

Updated May 21, 2023 • 26

michaelfeil/ct2fast-pythia-160m

Updated May 19, 2023 • 30 • 1

michaelfeil/ct2fast-gpt-neox-20b

Updated May 19, 2023 • 28

michaelfeil/ct2fast-Pythia-Chat-Base-7B

Updated May 21, 2023 • 3 • 1

michaelfeil/ct2fast-pythia-2.8b

Updated May 19, 2023 • 26 • 1

michaelfeil/ct2fast-pythia-6.9b

Updated May 19, 2023 • 30 • 1

michaelfeil/ct2fast-stablelm-7b-sft-v7-epoch-3

Text Generation • Updated Jun 2, 2023 • 18

michaelfeil/ct2fast-stablelm-tuned-alpha-7b

Updated May 22, 2023 • 24