Midnight-Rose-70B-v2.0.3
ExLlamav2 3.75 bpw quants of https://huggingface.co/sophosympatheia/Midnight-Rose-70B-v2.0.3
- Downloads last month
- 7
Inference API (serverless) is not available, repository is disabled.
Model tree for altomek/Midnight-Rose-70B-v2.0.3-3.75bpw-EXL2
Base model
sophosympatheia/Midnight-Rose-70B-v2.0.3
Finetuned
this model
Evaluation results
- normalized accuracy on AI2 Reasoning Challenge (25-Shot)test set Open LLM Leaderboard70.650
- normalized accuracy on HellaSwag (10-Shot)validation set Open LLM Leaderboard87.500
- accuracy on MMLU (5-Shot)test set Open LLM Leaderboard69.640
- mc2 on TruthfulQA (0-shot)validation set Open LLM Leaderboard65.270
- accuracy on Winogrande (5-shot)validation set Open LLM Leaderboard81.220
- accuracy on GSM8k (5-shot)test set Open LLM Leaderboard28.350