| license: mit | |
| datasets: | |
| - HuggingFaceFW/fineweb | |
| language: | |
| - en | |
| # llm.c checkpoint: GPT-2 774M | |
| This is a HF/safetensors conversion of the llm.c checkpoint of a 774M parameter run on 150B tokens from FineWeb. | |
| Training was conducted on a single 8xA100 80GB SXM node for ~6 days. | |
| See [discussion on GitHub](https://github.com/karpathy/llm.c/discussions/580) for more information. |