SmolLM models in MLC, ONNX and GGUF format for local applications + in-browser demos
Hugging Face TB Research
Enterprise
community
AI & ML interests
Exploring synthetic datasets, generated by Large Language Models (TB is for Textbook, as inspired by the "Textbooks are all your need" paper)
Organization Card
HuggingFaceTB
This is the home of synthetic datasets for pre-training, such as Cosmopedia v1 and v2. We're trying to scale synthetic data generation by curating diverse prompts that cover a wide range of topics and efficiently scaling the generations on GPUs with tools like llm-swarm.
We released:
- Cosmopedia: the largest open synthetic dataset, with 25B tokens and more than 30M samples. It contains synthetic textbooks, blog posts, stories, posts, and WikiHow articles generated by Mixtral-8x7B-Instruct-v0.1.
- Cosmo-1B a 1B model trained on Cosmopedia.
- FineWeb-Edu: a filtered version of FineWeb dataset for educational content
- SmolLM models: a series of strong small models in three sizes: 135M, 360M and 1.7B
- Smollm-Corpus: the pre-training corpus of SmolLM models including Cosmopedia v0.2, FineWeb-Edu and Python-Edu.
For more details check our blog posts: https://huggingface.co/blog/cosmopedia and https://huggingface.co/blog/smollm
models
23
HuggingFaceTB/classifier-python-clip1-4
Updated
HuggingFaceTB/classifier-python-clip-1-5
Updated
HuggingFaceTB/classifier-python-clip
Updated
HuggingFaceTB/test-python-edu-classifier
Updated
HuggingFaceTB/stack-edu-snowflake-python-512gbs-lr
Updated
•
1
HuggingFaceTB/SmolLM-135M-Instruct
Text Generation
•
Updated
•
21.2k
•
86
HuggingFaceTB/cosmo2-tokenizer
Updated
•
1
HuggingFaceTB/SmolLM-1.7B-Instruct
Text Generation
•
Updated
•
26.7k
•
96
HuggingFaceTB/SmolLM-360M-Instruct
Text Generation
•
Updated
•
29.6k
•
64
HuggingFaceTB/smollm-135M-instruct-v0.2-Q8_0-GGUF
Updated
•
637
•
3
datasets
29
HuggingFaceTB/smollm-corpus
Viewer
•
Updated
•
237M
•
3.37k
•
206
HuggingFaceTB/alpaca_eval_details
Viewer
•
Updated
•
2.42k
•
4
HuggingFaceTB/everyday-conversations-llama3.1-2k
Viewer
•
Updated
•
2.38k
•
2.62k
•
70
HuggingFaceTB/instruct-data-basics-smollm-H4
Viewer
•
Updated
•
767
•
687
HuggingFaceTB/self-oss-instruct-sc2-H4
Viewer
•
Updated
•
50.7k
•
673
•
1
HuggingFaceTB/Magpie-Pro-300K-Filtered-H4
Viewer
•
Updated
•
300k
•
638
•
1
HuggingFaceTB/OpenHermes-2.5-H4
Viewer
•
Updated
•
1M
•
659
•
1
HuggingFaceTB/bisac_expanded_topics
Viewer
•
Updated
•
34.2k
•
4
HuggingFaceTB/cosmopedia
Viewer
•
Updated
•
31.1M
•
12.3k
•
548
HuggingFaceTB/python-edu-annotations
Viewer
•
Updated
•
491k
•
34