---
license: apache-2.0
---
|    Tasks    |Version|Filter|n-shot| Metric |   |Value |   |Stderr|
|-------------|------:|------|-----:|--------|---|-----:|---|-----:|
|arc_challenge|      1|none  |     0|acc     |↑  |0.2176|±  |0.0121|
|             |       |none  |     0|acc_norm|↑  |0.2782|±  |0.0131|
|arc_easy     |      1|none  |     0|acc     |↑  |0.2584|±  |0.0090|
|             |       |none  |     0|acc_norm|↑  |0.2508|±  |0.0089|
|boolq        |      2|none  |     0|acc     |↑  |0.3807|±  |0.0085|
|hellaswag    |      1|none  |     0|acc     |↑  |0.2553|±  |0.0044|
|             |       |none  |     0|acc_norm|↑  |0.2634|±  |0.0044|
|openbookqa   |      1|none  |     0|acc     |↑  |0.1660|±  |0.0167|
|             |       |none  |     0|acc_norm|↑  |0.3020|±  |0.0206|
|piqa         |      1|none  |     0|acc     |↑  |0.5256|±  |0.0117|
|             |       |none  |     0|acc_norm|↑  |0.5272|±  |0.0116|
|winogrande   |      1|none  |     0|acc     |↑  |0.5249|±  |0.0140|