sophosympatheia
/

Midnight-Miqu-70B-v1.5

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

sophosympatheia commited on Mar 15

Commit

444fc91

•

1 Parent(s): 652128b

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -169,6 +169,8 @@ You could also try ChatML (don't recommend it)
 ```
 ### Quantizations
 * GPTQ
   * [Kotokin/Midnight-Miqu-70B-v1.5_GPTQ32G](https://huggingface.co/Kotokin/Midnight-Miqu-70B-v1.5_GPTQ32G)
 * EXL2

 ```
 ### Quantizations
+* GGUF
+  * [mradermacher/Midnight-Miqu-70B-v1.5-GGUF](https://huggingface.co/mradermacher/Midnight-Miqu-70B-v1.5-GGUF) -- Various static GGUF quants
 * GPTQ
   * [Kotokin/Midnight-Miqu-70B-v1.5_GPTQ32G](https://huggingface.co/Kotokin/Midnight-Miqu-70B-v1.5_GPTQ32G)
 * EXL2