2Q_S Quants
Any hope for the 2Q_S quants? They're preferred by me because they can fit within 24GB VRAM.
Thank you for filling the iQaunt gaps!
Yes, but you have to be patient. When this model was originally quantized IQ2_S didn't exist yet, but all missing models (that I normally provide) will be added even to the "old" models, and in fact, are also in the queue. Unfortunately, it's in alphabetical order and the fixup queue is currently at "Aurora...".
I'll see if I can make the IQ2_S earlier.
Actually, you are in the wrong repo, the IQ2_S (which I think you mean) is an imatrix quant and can be found at https://huggingface.co/mradermacher/Midnight-Miqu-70B-v1.0-i1-GGUF
If you mean Q2_K_S, then I don't plan to provide it, as it seems to be too low quality (And better alternatives at same and smaler size are available) - but with a good argument for its usefulness I could be pursuaded to provide that one as well.