Uma-4x7B-MoE-Function-calling-v0.2
Hey there! π Welcome to the Uma-4x7B-MoE-Function-calling-v0.2! This is a merge of multiple models brought together using the awesome VortexMerge kit.
Let's see what we've got in this merge:
- Trelis/Llama-2-7b-chat-hf-function-calling-v3 π
- xalss/Qwen2-7B-Instruct-glaive-function-calling π
- InterSync/Mistral-7B-Instruct-v0.2-Function-Calling π
- NousResearch/Hermes-2-Pro-Mistral-7B π
𧩠Configuration
models:
- model: Trelis/Llama-2-7b-chat-hf-function-calling-v3
parameters:
weight: 0.30
- model: xalss/Qwen2-7B-Instruct-glaive-function-calling
parameters:
weight: 0.60
- model: InterSync/Mistral-7B-Instruct-v0.2-Function-Calling
parameters:
weight: 0.90
- model: NousResearch/Hermes-2-Pro-Mistral-7B
parameters:
weight: 1.0
merge_method: linear
dtype: float16