Agent Skills: inference-serving-vllm

Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.

ID: davila7/claude-code-templates/inference-serving-vllm

Install this agent skill to your local

npx skills add davila7/claude-code-templates --skill inference-serving-vllm

Skill Files

The files that make up inference-serving-vllm.

Download Skill

More agent skills