Collections

Collection for: "Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale"

Adapted small language models used to generate data refining programs

a collection of pre-training corpora refined by ProX