Agent Skills: inference-serving-sglang

Fast structured generation and serving for LLMs with RadixAttention prefix caching. Use for JSON/regex outputs, constrained decoding, agentic workflows with tool calls, or when you need 5× faster inference than vLLM with prefix sharing. Powers 300,000+ GPUs at xAI, AMD, NVIDIA, and LinkedIn.

ID: davila7/claude-code-templates/inference-serving-sglang

Install this agent skill to your local

npx skills add davila7/claude-code-templates --skill inference-serving-sglang

Skill Files

The files that make up inference-serving-sglang.

Download Skill

More agent skills