--- language: - en - fr - de - es - it - pt - ru - zh - ja license: apache-2.0 quantized_by: pipilok pipeline_tag: text-generation base_model: - mistralai/Mistral-Small-Instruct-2409 --- Original model: https://huggingface.co/mistralai/Mistral-Small-Instruct-2409 Tested on Snapdragon X Elite with LM Studio 0.3.2 ARM64 Technology Preview https://lmstudio.ai/snapdragon Avg answer Speed: 6 tok/s ## LM Studio Settings: ``` Before System: [INST]<>\n After System: <[/INST]\n Before User: [INST] After User: [INST]\n Before Assistant: After Assistant: ```