| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| arc_challenge | 1 | none | 0 | acc | ↑ | 0.2176 | ± | 0.0121 |
| none | 0 | acc_norm | ↑ | 0.2628 | ± | 0.0129 | ||
| arc_easy | 1 | none | 0 | acc | ↑ | 0.2538 | ± | 0.0089 |
| none | 0 | acc_norm | ↑ | 0.2475 | ± | 0.0089 | ||
| boolq | 2 | none | 0 | acc | ↑ | 0.4239 | ± | 0.0086 |
| hellaswag | 1 | none | 0 | acc | ↑ | 0.2566 | ± | 0.0044 |
| none | 0 | acc_norm | ↑ | 0.2606 | ± | 0.0044 | ||
| openbookqa | 1 | none | 0 | acc | ↑ | 0.1340 | ± | 0.0152 |
| none | 0 | acc_norm | ↑ | 0.2660 | ± | 0.0198 | ||
| piqa | 1 | none | 0 | acc | ↑ | 0.5381 | ± | 0.0116 |
| none | 0 | acc_norm | ↑ | 0.5190 | ± | 0.0117 | ||
| winogrande | 1 | none | 0 | acc | ↑ | 0.4704 | ± | 0.0140 |
- Downloads last month
- 21
Inference API (serverless) is not available, repository is disabled.