Agent Skills: model-serving

LLM and ML model deployment for inference. Use when serving models in production, building AI APIs, or optimizing inference. Covers vLLM (LLM serving), TensorRT-LLM (GPU optimization), Ollama (local), BentoML (ML deployment), Triton (multi-model), LangChain (orchestration), LlamaIndex (RAG), and streaming patterns.

UncategorizedID: ancoleman/ai-design-components/model-serving

Install this agent skill to your local

pnpm dlx add-skill https://github.com/ancoleman/ai-design-components/model-serving

Skill Files

Browse the full folder contents for model-serving.

Download Skill

Loading file tree…

Select a file to preview its contents.