uukuguy leaderboard-pr-bot commited on
Commit
9b9a961
1 Parent(s): eb96d71

Adding Evaluation Results (#2)

Browse files

- Adding Evaluation Results (934526b86edf1b5473d804f6778dbc5b2639d5be)


Co-authored-by: Open LLM Leaderboard PR Bot <[email protected]>

Files changed (1) hide show
  1. README.md +14 -0
README.md CHANGED
@@ -134,3 +134,17 @@ Mistral 7B is a pretrained base model and therefore does not have any moderation
134
  ## The Mistral AI Team
135
 
136
  Albert Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix, William El Sayed.`
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
134
  ## The Mistral AI Team
135
 
136
  Albert Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix, William El Sayed.`
137
+
138
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
139
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_uukuguy__speechless-mistral-six-in-one-7b)
140
+
141
+ | Metric | Value |
142
+ |-----------------------|---------------------------|
143
+ | Avg. | 53.38 |
144
+ | ARC (25-shot) | 62.97 |
145
+ | HellaSwag (10-shot) | 84.6 |
146
+ | MMLU (5-shot) | 63.29 |
147
+ | TruthfulQA (0-shot) | 57.77 |
148
+ | Winogrande (5-shot) | 77.51 |
149
+ | GSM8K (5-shot) | 18.42 |
150
+ | DROP (3-shot) | 9.13 |