Abliterated quant?
Hi, thanks for all the hard work you do for the community.
Is there any chance you can make a Llama 3.1 70B Instruct Abliterated GGUF quant? And if beggars can be choosers...Q8 please?
I find the uncensored models to be much more useful for my line of work (writer).
thanks!
Can you link me the 3.1 70b abliterated? I can't seem to find one
Oh no, I was asking if you could make an abliterated quant for Llama 3.1 70B.
Or is that not how it works?
nah that's not how it works, someone has to make the model and then i can quant it :)
Ahhh I see. Who can we ask to make the 3.1 70b Abliterated quant?
I will have 120GB of VRAM in about a week from now—is that enough if I were to offer controlled access to my GPUs to someone trustworthy (assuming access to enough VRAM is the reason why nobody has done it).