Fredithefish/MadMix-v0.2

🔥 MadMix: Merging the top Seven Billion-Parameter Mistral-Based Open Source Models 🔥

This Model is a ties merge between various high-quality open-source models, it was done by using the https://github.com/cg123/mergekit repository.

Details

Due to the apache-2 license, the model is fully commercially usable

• Models included in the merge:
  • OpenChat_3.5
  • MetaMath 7B
  • Zephyr 7B beta
  • OpenHermes-2.5
  • Neural-chat 7b v3.1
  • Mistral-7B v0.1 (serving as the base for the merge)

Evals

(soon...)