Back to tags
Tag

Agent Skills with tag: Production

12 skills match this tag. Use tags to discover related Agent Skills and explore similar workflows.

inference-serving-tensorrt-llm

Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency. Use for production deployment on NVIDIA GPUs (A100/H100), when you need 10-100x faster inference than PyTorch, or for serving models with quantization (FP8/INT4), in-flight batching, and multi-GPU scaling.

[InferenceServingTensorRT-LLMNVIDIA
Orchestra Research
Orchestra Research
33,1943,891

inference-serving-vllm

Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.

[vLLMInferenceServingPagedAttention
Orchestra Research
Orchestra Research
33,1943,891

rag-pinecone

Managed vector database for production AI applications. Fully managed, auto-scaling, with hybrid search (dense + sparse), metadata filtering, and namespaces. Low latency (<100ms p95). Use for production RAG, recommendation systems, or semantic search at scale. Best for serverless, managed infrastructure.

[RAGPineconeVectorDatabase
Orchestra Research
Orchestra Research
33,1943,891

serving-llms-vllm

vLLM: high-throughput LLM serving, OpenAI API, quantization.

[vLLMInferenceServingPagedAttention
delorenj
delorenj
176

serving-llms-vllm

vLLM: high-throughput LLM serving, OpenAI API, quantization.

[vLLMInferenceServingPagedAttention
poorrican
poorrican
0

tensorrt-llm

Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency. Use for production deployment on NVIDIA GPUs (A100/H100), when you need 10-100x faster inference than PyTorch, or for serving models with quantization (FP8/INT4), in-flight batching, and multi-GPU scaling.

[InferenceServingTensorRT-LLMNVIDIA
poorrican
poorrican
0

pinecone

Managed vector database for production AI applications. Fully managed, auto-scaling, with hybrid search (dense + sparse), metadata filtering, and namespaces. Low latency (<100ms p95). Use for production RAG, recommendation systems, or semantic search at scale. Best for serverless, managed infrastructure.

[RAGPineconeVectorDatabase
poorrican
poorrican
0

qdrant-vector-search

High-performance vector similarity search engine for RAG and semantic search. Use when building production RAG systems requiring fast nearest neighbor search, hybrid search with filtering, or scalable vector storage with Rust-powered performance.

[RAGVectorSearchQdrant
poorrican
poorrican
0

serving-llms-vllm

vLLM: high-throughput LLM serving, OpenAI API, quantization.

[vLLMInferenceServingPagedAttention
PoorRican
PoorRican
0

tensorrt-llm

Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency. Use for production deployment on NVIDIA GPUs (A100/H100), when you need 10-100x faster inference than PyTorch, or for serving models with quantization (FP8/INT4), in-flight batching, and multi-GPU scaling.

[InferenceServingTensorRT-LLMNVIDIA
PoorRican
PoorRican
0

pinecone

Managed vector database for production AI applications. Fully managed, auto-scaling, with hybrid search (dense + sparse), metadata filtering, and namespaces. Low latency (<100ms p95). Use for production RAG, recommendation systems, or semantic search at scale. Best for serverless, managed infrastructure.

[RAGPineconeVectorDatabase
PoorRican
PoorRican
0

qdrant-vector-search

High-performance vector similarity search engine for RAG and semantic search. Use when building production RAG systems requiring fast nearest neighbor search, hybrid search with filtering, or scalable vector storage with Rust-powered performance.

[RAGVectorSearchQdrant
PoorRican
PoorRican
0