GGUF Version? =)

by SimSim93 - opened Dec 4, 2023

Dec 4, 2023

This seems to be the best 7b model right now. It would be awesome if you could provide everybode with a gguf version of this model! =)

By the way: Thank you for your work!

And of course thank you to @fblgit for providing this awesome version of mistral! =)

fblgit

Owner Dec 4, 2023

hehe my pleasure. and yeah thanks @TheBloke and @bartowski for their gigantic contribution to the community.
looking forward to see this one on llm studio main page card :D

bartowski

Dec 5, 2023

•

edited Dec 5, 2023

Starting the quant now :D thank you uploading safetensors, always appreciated ;)

files will appear here as they're ready: https://huggingface.co/bartowski/una-cybertron-7b-v2-exl2

zcmcdonough

Dec 6, 2023

•

edited Dec 6, 2023

I'd like to test this on a small dataset of prices of a 2nd hand good market and see how much analytical extrapolation can be done with it w/ a GGUF version :)

fblgit

Owner Dec 6, 2023

thanks everyone, Q & GG versions are out already. closing this.

fblgit changed discussion status to closed Dec 6, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment