NeverSleep
/

Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (1)

A new HQQ Quantization in <16GB VRAM

#8 opened 5 months ago by

Silly Tavern Settings

#7 opened 7 months ago by

What is the correct prompt format for this model?

#6 opened 8 months ago by

Peak

#5 opened 8 months ago by

1.64-upmanship (2 bit HQQ quantize)

#3 opened 8 months ago by

ProphetOfBostrom

EXL2 - 3.64 bpw

#2 opened 8 months ago by

Recommended settings?

#1 opened 8 months ago by