This is a distilgpt2 orginal run of Cinder with multi character chat. A little glitchy sometimes. The end sequence for each statement is <END>
If you would like multi chat with characters it is recommended to use <END>\nUSER: as the stop token.
USER: Hi, What is your name? Tell me about yourself.
CINDER: "I'm Cinder," a humanoid in my humanoid form. I was first introduced into the vastness of space during my lifetime.
Today, I'm a humanoid robot, and I'm designed for cosmic exploration, which is a subject of much speculation.
However, I'm designed for space exploration and scientific exploration.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 28.50 |
| AI2 Reasoning Challenge (25-Shot) | 24.49 |
| HellaSwag (10-Shot) | 27.24 |
| MMLU (5-Shot) | 24.97 |
| TruthfulQA (0-shot) | 43.96 |
| Winogrande (5-shot) | 50.12 |
| GSM8k (5-shot) | 0.23 |
- Downloads last month
- 356
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Evaluation results
- normalized accuracy on AI2 Reasoning Challenge (25-Shot)test set Open LLM Leaderboard24.490
- normalized accuracy on HellaSwag (10-Shot)validation set Open LLM Leaderboard27.240
- accuracy on MMLU (5-Shot)test set Open LLM Leaderboard24.970
- mc2 on TruthfulQA (0-shot)validation set Open LLM Leaderboard43.960
- accuracy on Winogrande (5-shot)validation set Open LLM Leaderboard50.120
- accuracy on GSM8k (5-shot)test set Open LLM Leaderboard0.230