metadata
license: apache-2.0
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| arc_challenge | 1 | none | 0 | acc | ↑ | 0.2176 | ± | 0.0121 |
| none | 0 | acc_norm | ↑ | 0.2782 | ± | 0.0131 | ||
| arc_easy | 1 | none | 0 | acc | ↑ | 0.2584 | ± | 0.0090 |
| none | 0 | acc_norm | ↑ | 0.2508 | ± | 0.0089 | ||
| boolq | 2 | none | 0 | acc | ↑ | 0.3807 | ± | 0.0085 |
| hellaswag | 1 | none | 0 | acc | ↑ | 0.2553 | ± | 0.0044 |
| none | 0 | acc_norm | ↑ | 0.2634 | ± | 0.0044 | ||
| openbookqa | 1 | none | 0 | acc | ↑ | 0.1660 | ± | 0.0167 |
| none | 0 | acc_norm | ↑ | 0.3020 | ± | 0.0206 | ||
| piqa | 1 | none | 0 | acc | ↑ | 0.5256 | ± | 0.0117 |
| none | 0 | acc_norm | ↑ | 0.5272 | ± | 0.0116 | ||
| winogrande | 1 | none | 0 | acc | ↑ | 0.5249 | ± | 0.0140 |