|
--- |
|
license: apache-2.0 |
|
--- |
|
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr| |
|
|-------------|------:|------|-----:|--------|---|-----:|---|-----:| |
|
|arc_challenge| 1|none | 0|acc |↑ |0.2176|± |0.0121| |
|
| | |none | 0|acc_norm|↑ |0.2782|± |0.0131| |
|
|arc_easy | 1|none | 0|acc |↑ |0.2584|± |0.0090| |
|
| | |none | 0|acc_norm|↑ |0.2508|± |0.0089| |
|
|boolq | 2|none | 0|acc |↑ |0.3807|± |0.0085| |
|
|hellaswag | 1|none | 0|acc |↑ |0.2553|± |0.0044| |
|
| | |none | 0|acc_norm|↑ |0.2634|± |0.0044| |
|
|openbookqa | 1|none | 0|acc |↑ |0.1660|± |0.0167| |
|
| | |none | 0|acc_norm|↑ |0.3020|± |0.0206| |
|
|piqa | 1|none | 0|acc |↑ |0.5256|± |0.0117| |
|
| | |none | 0|acc_norm|↑ |0.5272|± |0.0116| |
|
|winogrande | 1|none | 0|acc |↑ |0.5249|± |0.0140| |
