Agent Skills: ai-pretraining

Builds a transformer/GPT and BPE tokenizer from scratch. Use when implementing autograd, self-attention, a nanoGPT-style pretraining loop, or a byte-level tokenizer.

UncategorizedID: vasilyu1983/ai-agents-public/ai-pretraining

Author

vasilyu1983

https://github.com/vasilyu1983 View all skills

Repository

vasilyu1983/ai-agents-public

vasilyu1983License: MIT

8719

Install this agent skill to your local

pnpm dlx add-skill https://github.com/vasilyu1983/ai-agents-public/ai-pretraining

Skill Files

Browse the full folder contents for ai-pretraining.

Download Skill

Loading file tree…

Select a file to preview its contents.