instruction-pretrain's picture

instruction-pretrain

instruction-pretrain

·

https://huggingface.co/papers/2406.14491

DaixuanC45443

AI & ML interests

Synthetic Instructions for Pre-Training

Organizations

None yet

models 5

instruction-pretrain/instruction-synthesizer

Text Generation • Updated Sep 20 • 273 • 72

instruction-pretrain/finance-Llama3-8B

Text Generation • Updated Sep 20 • 573 • 49

instruction-pretrain/medicine-Llama3-8B

Text Generation • Updated Sep 20 • 504 • 34

instruction-pretrain/InstructLM-1.3B

Text Generation • Updated Sep 20 • 85 • 41

instruction-pretrain/InstructLM-500M

Text Generation • Updated Sep 20 • 428 • 34

datasets 3

instruction-pretrain/ft-instruction-synthesizer-collection

Viewer • Updated Sep 20 • 249k • 289 • 58

instruction-pretrain/general-instruction-augmented-corpora

Preview • Updated Sep 20 • 11.8k • 14

instruction-pretrain/medicine-instruction-augmented-corpora

Preview • Updated Sep 20 • 303 • 11