Hey @TheBloke will you quantize those?
It appears they are! E.g https://huggingface.co/TheBloke/tulu-2-dpo-70B-GPTQ
· Sign up or log in to comment