| license: cc-by-nc-4.0 | |
| <!-- description start --> | |
| ## Description | |
| This repo contains fp16 files of personal mix : "UndiMix-v4". | |
| It can be hot, serious, playful, and can use emoji thanks to llama-2-13b-chat-limarp-v2-merged. | |
| Atomicorn... Hope you will like this one kek, you waited enough. | |
| <!-- description end --> | |
| <!-- description start --> | |
| ## Models used | |
| - Undi95/ReMM-v2-Kimiko-v2-13B (0.272) (base) | |
| - The-Face-Of-Goonery/Huginn-13b-v1.2 (0.264) | |
| - Doctor-Shotgun/llama-2-13b-chat-limarp-v2-merged (0.264) | |
| - jondurbin/airoboros-l2-13b-2.2 (0.10) | |
| - IkariDev/Athena-v1 (0.10) | |
| <!-- description end --> | |
| <!-- prompt-template start --> | |
| ## Prompt template: Alpaca | |
| ``` | |
| Below is an instruction that describes a task. Write a response that appropriately completes the request. | |
| ### Instruction: | |
| {prompt} | |
| ### Response: | |
| ``` | |
| Special thanks to Sushi. | |
| # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard) | |
| Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Undi95__UndiMix-v4-13B) | |
| | Metric | Value | | |
| |-----------------------|---------------------------| | |
| | Avg. | 51.77 | | |
| | ARC (25-shot) | 61.95 | | |
| | HellaSwag (10-shot) | 83.88 | | |
| | MMLU (5-shot) | 56.9 | | |
| | TruthfulQA (0-shot) | 48.96 | | |
| | Winogrande (5-shot) | 76.16 | | |
| | GSM8K (5-shot) | 13.72 | | |
| | DROP (3-shot) | 20.82 | | |