shuvom
/

my-mixtral-2x7B

Text Generation

Mixture of Experts

mistralai/Mistral-7B-Instruct-v0.2

OpenPipe/mistral-ft-optimized-1218

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

my-mixtral-2x7B / mergekit_moe_config.yml

shuvom's picture

Upload folder using huggingface_hub

0515023 verified 10 months ago

history blame contribute delete

270 Bytes


	base_model: mistralai/Mistral-7B-Instruct-v0.2
	gate_mode: cheap_embed
	experts:
	- source_model: mistralai/Mistral-7B-Instruct-v0.2
	positive_prompts:
	- "chat"
	- "assistant"
	- source_model: OpenPipe/mistral-ft-optimized-1218
	positive_prompts: [""]