Interesting read
Thanks for the detailed explanation on this repo page and I'm really curious to see if this improves my MistralTrix hobby project and does even better.
I'll keep an eye out on this one. Thanks for sharing, and exciting times indeed! :)
yeah man, it's no big deal, and I really appreciate you making a GGUF convert of your model. I don't have a very high-end system so even my own merges are really more for research purposes. Having a model to actually inference with is really nice :)
your model turned out well, too...so just continue with confidence and try to research whatever interests and inspires you most.
I just realised that my MistralTrix model isn't mentioned anywhere on this page lol.
It's old news now so it's fine but that would've been a nice thing to do on your end! :)
I just realised that my MistralTrix model isn't mentioned anywhere on this page lol.
It's old news now so it's fine but that would've been a nice thing to do on your end! :)
this model is actually busted afaik I have no idea but the 9B passthrough models back then were not working with the MoE script. Also I was just learning how to write model cards, today I would give you a shoutout just for putting a single line of code into the architecture lol