Edit model card
| Tasks |
Version |
Filter |
n-shot |
Metric |
|
Value |
|
Stderr |
| arc_challenge |
1 |
none |
0 |
acc |
↑ |
0.2176 |
± |
0.0121 |
|
|
none |
0 |
acc_norm |
↑ |
0.2782 |
± |
0.0131 |
| arc_easy |
1 |
none |
0 |
acc |
↑ |
0.2584 |
± |
0.0090 |
|
|
none |
0 |
acc_norm |
↑ |
0.2508 |
± |
0.0089 |
| boolq |
2 |
none |
0 |
acc |
↑ |
0.3807 |
± |
0.0085 |
| hellaswag |
1 |
none |
0 |
acc |
↑ |
0.2553 |
± |
0.0044 |
|
|
none |
0 |
acc_norm |
↑ |
0.2634 |
± |
0.0044 |
| openbookqa |
1 |
none |
0 |
acc |
↑ |
0.1660 |
± |
0.0167 |
|
|
none |
0 |
acc_norm |
↑ |
0.3020 |
± |
0.0206 |
| piqa |
1 |
none |
0 |
acc |
↑ |
0.5256 |
± |
0.0117 |
|
|
none |
0 |
acc_norm |
↑ |
0.5272 |
± |
0.0116 |
| winogrande |
1 |
none |
0 |
acc |
↑ |
0.5249 |
± |
0.0140 |
Unable to determine this model's library. Check the
docs
.
