leaderboard-pr-bot commited on
Commit
934526b
1 Parent(s): eb96d71

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +14 -0
README.md CHANGED
@@ -134,3 +134,17 @@ Mistral 7B is a pretrained base model and therefore does not have any moderation
134
  ## The Mistral AI Team
135
 
136
  Albert Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix, William El Sayed.`
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
134
  ## The Mistral AI Team
135
 
136
  Albert Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix, William El Sayed.`
137
+
138
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
139
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_uukuguy__speechless-mistral-six-in-one-7b)
140
+
141
+ | Metric | Value |
142
+ |-----------------------|---------------------------|
143
+ | Avg. | 53.38 |
144
+ | ARC (25-shot) | 62.97 |
145
+ | HellaSwag (10-shot) | 84.6 |
146
+ | MMLU (5-shot) | 63.29 |
147
+ | TruthfulQA (0-shot) | 57.77 |
148
+ | Winogrande (5-shot) | 77.51 |
149
+ | GSM8K (5-shot) | 18.42 |
150
+ | DROP (3-shot) | 9.13 |