Agent Skills: speculative-decoding

Accelerate LLM inference using speculative decoding, Medusa multiple heads, and lookahead decoding techniques. Use when optimizing inference speed (1.5-3.6× speedup), reducing latency for real-time applications, or deploying models with limited compute. Covers draft models, tree-based attention, Jacobi iteration, parallel token generation, and production deployment strategies.

UncategorizedID: davila7/claude-code-templates/speculative-decoding

Install this agent skill to your local

pnpm dlx add-skill https://github.com/davila7/claude-code-templates/speculative-decoding

Skill Files

Browse the full folder contents for speculative-decoding.

Download Skill

Loading file tree…

Select a file to preview its contents.