Agent Skills: ai-data-curation-pretraining

Builds and audits LLM pretraining corpora: extraction, filtering, dedup, decontamination, data mixing, synthetic data. Use when curating or ablating a pretraining data pipeline.

UncategorizedID: vasilyu1983/ai-agents-public/ai-data-curation-pretraining

Author

vasilyu1983

https://github.com/vasilyu1983 View all skills

Repository

vasilyu1983/ai-agents-public

vasilyu1983License: MIT

8719

Install this agent skill to your local

pnpm dlx add-skill https://github.com/vasilyu1983/ai-agents-public/ai-data-curation-pretraining

Skill Files

Browse the full folder contents for ai-data-curation-pretraining.

Download Skill

Loading file tree…

Select a file to preview its contents.