Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

dataset:nvidia/HelpSteer

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

234

Full-text search

Active filters: nvidia/HelpSteer

YorkieOH10/granite-8b-code-instruct-Q8_0-GGUF

Text Generation • Updated May 6 • 36 • 7

YorkieOH10/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated May 6 • 205 • 6

mlx-community/granite-3b-code-instruct-4bit

Text Generation • Updated May 6 • 8

mlx-community/granite-3b-code-instruct-8bit

Text Generation • Updated May 6 • 6

mlx-community/granite-8b-code-instruct-4bit

Text Generation • Updated May 6 • 10

mlx-community/granite-8b-code-instruct-8bit

Text Generation • Updated May 6 • 6

mlx-community/granite-20b-code-instruct-4bit

Text Generation • Updated May 14 • 7

mlx-community/granite-20b-code-instruct-8bit

Text Generation • Updated May 14 • 5

mlx-community/granite-34b-code-instruct-8bit

Text Generation • Updated May 14 • 6

YorkieOH10/granite-34b-code-instruct-Q8_0-GGUF

Text Generation • Updated May 6 • 28 • 5

NikolayKozloff/granite-3b-code-instruct-Q8_0-GGUF

Text Generation • Updated May 7 • 397 • 2

NikolayKozloff/granite-20b-code-instruct-Q4_0-GGUF

Text Generation • Updated May 7 • 124 • 2

mlx-community/karakuri-lm-8x7b-chat-v0.1-8bit

Text Generation • Updated May 7 • 168 • 1

NikolayKozloff/granite-8b-code-instruct-Q6_K-GGUF

Text Generation • Updated May 7 • 12 • 2

jncraton/granite-3b-code-instruct-ct2-int8

Text Generation • Updated May 8 • 6

Wusul/granite-20b-code-instruct-Q5_K_M-GGUF

Text Generation • Updated May 8 • 386

YorkieOH10/granite-3b-code-instruct-Q8_0-GGUF

Text Generation • Updated May 9 • 11

YorkieOH10/granite-20b-code-instruct-Q8_0-GGUF

Text Generation • Updated May 9 • 7 • 3

SixOpen/granite-34b-code-instruct-Q5_K_M-GGUF

Text Generation • Updated May 10 • 17

fakezeta/Llama3-Aloe-8B-Alpha-ov-int8

Text Generation • Updated May 10 • 29 • 4

newsletter/granite-3b-code-instruct-Q6_K-GGUF

Text Generation • Updated May 10 • 4

newsletter/granite-8b-code-instruct-Q6_K-GGUF

Text Generation • Updated May 10 • 25

newsletter/granite-20b-code-instruct-Q6_K-GGUF

Text Generation • Updated May 10 • 7

upendrab/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated May 10 • 6

cobrakenji/granite-8b-code-instruct-Q3_K_M-GGUF

Text Generation • Updated May 11 • 2

cobrakenji/granite-20b-code-instruct-Q5_K_M-GGUF

Text Generation • Updated Jun 10 • 11

cobrakenji/granite-34b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 10 • 16 • 2

cpellens/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated May 11 • 3

TomWest/granite-8b-code-instruct-Q5_K_S-GGUF

Text Generation • Updated May 13 • 13

cobrakenji/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated May 13 • 4