A bit brain-damaged

#2
by ChuckMcSneed - opened

Combining models with different rope settings does not make a better model.

I've updated the model, it seems to be better now.

Thank you for your work alpindale! Your Goliath is the best open source model that exists in my opinion and I'm looking forward to trying miquella-120b!

I've been testing it in comparison with Goliath. In a direct chatbot-style conversation Miquella performed well. In a more creative and challenging discussion of characters with positions it struggled with coherency compared to Goliath. Still not finished testing, just my current findings.

Sign up or log in to comment