File size: 1,029 Bytes
1b49d64 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
license: apache-2.0
---
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|-------------|------:|------|-----:|--------|---|-----:|---|-----:|
|arc_challenge| 1|none | 0|acc |↑ |0.2176|± |0.0121|
| | |none | 0|acc_norm|↑ |0.2782|± |0.0131|
|arc_easy | 1|none | 0|acc |↑ |0.2584|± |0.0090|
| | |none | 0|acc_norm|↑ |0.2508|± |0.0089|
|boolq | 2|none | 0|acc |↑ |0.3807|± |0.0085|
|hellaswag | 1|none | 0|acc |↑ |0.2553|± |0.0044|
| | |none | 0|acc_norm|↑ |0.2634|± |0.0044|
|openbookqa | 1|none | 0|acc |↑ |0.1660|± |0.0167|
| | |none | 0|acc_norm|↑ |0.3020|± |0.0206|
|piqa | 1|none | 0|acc |↑ |0.5256|± |0.0117|
| | |none | 0|acc_norm|↑ |0.5272|± |0.0116|
|winogrande | 1|none | 0|acc |↑ |0.5249|± |0.0140| |