Back to authors
davila7

davila7

336 Skills published on GitHub.

inference-serving-llama-cpp

Runs LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. Use for edge deployment, M1/M2/M3 Macs, AMD/Intel GPUs, or when CUDA is unavailable. Supports GGUF quantization (1.5-8 bit) for reduced memory and 4-10× speedup vs PyTorch on CPU.

[InferenceServingLlama.cppCPUInferenceAppleSiliconEdgeDeploymentGGUFQuantizationNon-NVIDIAAMDGPUsIntelGPUsEmbedded]
UncategorizedView skill →

inference-serving-sglang

Fast structured generation and serving for LLMs with RadixAttention prefix caching. Use for JSON/regex outputs, constrained decoding, agentic workflows with tool calls, or when you need 5× faster inference than vLLM with prefix sharing. Powers 300,000+ GPUs at xAI, AMD, NVIDIA, and LinkedIn.

UncategorizedView skill →

inference-serving-tensorrt-llm

Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency. Use for production deployment on NVIDIA GPUs (A100/H100), when you need 10-100x faster inference than PyTorch, or for serving models with quantization (FP8/INT4), in-flight batching, and multi-GPU scaling.

[InferenceServingTensorRT-LLMNVIDIAInferenceOptimizationHighThroughputLowLatencyProductionFP8INT4In-FlightBatchingMulti-GPU]
UncategorizedView skill →

inference-serving-vllm

Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.

[vLLMInferenceServingPagedAttentionContinuousBatchingHighThroughputProductionOpenAIAPIQuantizationTensorParallelism]
UncategorizedView skill →

infrastructure-lambda-labs

Reserved and on-demand GPU cloud instances for ML training and inference. Use when you need dedicated GPU instances with simple SSH access, persistent filesystems, or high-performance multi-node clusters for large-scale training.

UncategorizedView skill →

infrastructure-modal

Serverless GPU cloud platform for running ML workloads. Use when you need on-demand GPU access without infrastructure management, deploying ML models as APIs, or running batch jobs with automatic scaling.

[InfrastructureServerlessGPUCloudDeploymentModal]
UncategorizedView skill →

infrastructure-skypilot

Multi-cloud orchestration for ML workloads with automatic cost optimization. Use when you need to run training or batch jobs across multiple clouds, leverage spot instances with auto-recovery, or optimize GPU costs across providers.

[InfrastructureMulti-CloudOrchestrationGPUCostOptimizationSkyPilot]
UncategorizedView skill →

langfuse

Expert in Langfuse - the open-source LLM observability platform. Covers tracing, prompt management, evaluation, datasets, and integration with LangChain, LlamaIndex, and OpenAI. Essential for debugging, monitoring, and improving LLM applications in production. Use when: langfuse, llm observability, llm tracing, prompt management, llm evaluation.

UncategorizedView skill →

llm-app-patterns

Production-ready patterns for building LLM applications. Covers RAG pipelines, agent architectures, prompt IDEs, and LLMOps monitoring. Use when designing AI applications, implementing RAG, building agents, or setting up LLM observability.

UncategorizedView skill →

llm-evaluation

Master comprehensive evaluation strategies for LLM applications, from automated metrics to human evaluation and A/B testing.

UncategorizedView skill →

loki-mode

Multi-agent autonomous startup system for Claude Code. Triggers on "Loki Mode". Orchestrates 100+ specialized agents across engineering, QA, DevOps, security, data/ML, business operations, marketing, HR, and customer success. Takes PRD to fully deployed, revenue-generating product with zero human intervention. Features Task tool for subagent dispatch, parallel code review with 3 specialized reviewers, severity-based issue triage, distributed task queue with dead letter handling, automatic deployment to cloud providers, A/B testing, customer feedback loops, incident response, circuit breakers, and self-healing. Handles rate limits via distributed state checkpoints and auto-resume with exponential backoff. Requires --dangerously-skip-permissions flag.

UncategorizedView skill →

mechanistic-interpretability-nnsight

Provides guidance for interpreting and manipulating neural network internals using nnsight with optional NDIF remote execution. Use when needing to run interpretability experiments on massive models (70B+) without local GPU resources, or when working with any PyTorch architecture.

[nnsightNDIFRemoteExecutionMechanisticInterpretabilityModelInternals]
UncategorizedView skill →

mechanistic-interpretability-pyvene

Provides guidance for performing causal interventions on PyTorch models using pyvene's declarative intervention framework. Use when conducting causal tracing, activation patching, interchange intervention training, or testing causal hypotheses about model behavior.

[CausalInterventionpyveneActivationPatchingCausalTracingInterpretability]
UncategorizedView skill →

mechanistic-interpretability-saelens

Provides guidance for training and analyzing Sparse Autoencoders (SAEs) using SAELens to decompose neural network activations into interpretable features. Use when discovering interpretable features, analyzing superposition, or studying monosemantic representations in language models.

[SparseAutoencodersSAEMechanisticInterpretabilityFeatureDiscoverySuperposition]
UncategorizedView skill →

mechanistic-interpretability-transformer-lens

Provides guidance for mechanistic interpretability research using TransformerLens to inspect and manipulate transformer internals via HookPoints and activation caching. Use when reverse-engineering model algorithms, studying attention patterns, or performing activation patching experiments.

[MechanisticInterpretabilityTransformerLensActivationPatchingCircuitAnalysis]
UncategorizedView skill →

ml-engineer

Build production ML systems with PyTorch 2.x, TensorFlow, and modern ML frameworks. Implements model serving, feature engineering, A/B testing, and monitoring.

UncategorizedView skill →

mlops-mlflow

Track ML experiments, manage model registry with versioning, deploy models to production, and reproduce experiments with MLflow - framework-agnostic ML lifecycle platform

[MLOpsMLflowExperimentTrackingModelRegistryMLLifecycleDeploymentModelVersioningPyTorchTensorFlowScikit-LearnHuggingFace]
UncategorizedView skill →

mlops-tensorboard

Visualize training metrics, debug models with histograms, compare experiments, visualize model graphs, and profile performance with TensorBoard - Google's ML visualization toolkit

[MLOpsTensorBoardVisualizationTrainingMetricsModelDebuggingPyTorchTensorFlowExperimentTrackingPerformanceProfiling]
UncategorizedView skill →

mlops-weights-and-biases

Track ML experiments with automatic logging, visualize training in real-time, optimize hyperparameters with sweeps, and manage model registry with W&B - collaborative MLOps platform

[MLOpsWeightsAndBiasesWandBExperimentTrackingHyperparameterTuningModelRegistryCollaborationReal-TimeVisualizationPyTorchTensorFlowHuggingFace]
UncategorizedView skill →

model-architecture-litgpt

Implements and trains LLMs using Lightning AI's LitGPT with 20+ pretrained architectures (Llama, Gemma, Phi, Qwen, Mistral). Use when need clean model implementations, educational understanding of architectures, or production fine-tuning with LoRA/QLoRA. Single-file implementations, no abstraction layers.

[ModelArchitectureLitGPTLightningAILLMImplementationLoRAQLoRAFine-TuningLlamaGemmaPhiMistralEducational]
UncategorizedView skill →

model-architecture-mamba

State-space model with O(n) complexity vs Transformers' O(n²). 5× faster inference, million-token sequences, no KV cache. Selective SSM with hardware-aware design. Mamba-1 (d_state=16) and Mamba-2 (d_state=128, multi-head). Models 130M-2.8B on HuggingFace.

[ModelArchitectureMambaStateSpaceModelsSSMLinearComplexityLongContextEfficientInferenceHardware-AwareAlternativeToTransformers]
UncategorizedView skill →

model-architecture-nanogpt

Educational GPT implementation in ~300 lines. Reproduces GPT-2 (124M) on OpenWebText. Clean, hackable code for learning transformers. By Andrej Karpathy. Perfect for understanding GPT architecture from scratch. Train on Shakespeare (CPU) or OpenWebText (multi-GPU).

[ModelArchitectureNanoGPTGPT-2EducationalAndrejKarpathyTransformerMinimalistFromScratchTraining]
UncategorizedView skill →

model-architecture-rwkv

RNN+Transformer hybrid with O(n) inference. Linear time, infinite context, no KV cache. Train like GPT (parallel), infer like RNN (sequential). Linux Foundation AI project. Production at Windows, Office, NeMo. RWKV-7 (March 2025). Models up to 14B parameters.

[RWKVModelArchitectureRNNTransformerHybridLinearComplexityInfiniteContextEfficientInferenceLinuxFoundationAlternativeArchitecture]
UncategorizedView skill →

model-architecture-torchtitan

Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing.

[ModelArchitectureDistributedTrainingTorchTitanFSDP2TensorParallelPipelineParallelContextParallelFloat8LlamaPretraining]
UncategorizedView skill →

multimodal-audiocraft

PyTorch library for audio generation including text-to-music (MusicGen) and text-to-sound (AudioGen). Use when you need to generate music from text descriptions, create sound effects, or perform melody-conditioned music generation.

[MultimodalAudioGenerationText-to-MusicText-to-AudioMusicGen]
UncategorizedView skill →

multimodal-blip-2

Vision-language pre-training framework bridging frozen image encoders and LLMs. Use when you need image captioning, visual question answering, image-text retrieval, or multimodal chat with state-of-the-art zero-shot performance.

[MultimodalVision-LanguageImageCaptioningVQAZero-Shot]
UncategorizedView skill →

multimodal-clip

OpenAI's model connecting vision and language. Enables zero-shot image classification, image-text matching, and cross-modal retrieval. Trained on 400M image-text pairs. Use for image search, content moderation, or vision-language tasks without fine-tuning. Best for general-purpose image understanding.

[MultimodalCLIPVision-LanguageZero-ShotImageClassificationOpenAIImageSearchCross-ModalRetrievalContentModeration]
UncategorizedView skill →

multimodal-llava

Large Language and Vision Assistant. Enables visual instruction tuning and image-based conversations. Combines CLIP vision encoder with Vicuna/LLaMA language models. Supports multi-turn image chat, visual question answering, and instruction following. Use for vision-language chatbots or image understanding tasks. Best for conversational image analysis.

[LLaVAVision-LanguageMultimodalVisualQuestionAnsweringImageChatCLIPVicunaConversationalAIInstructionTuningVQA]
UncategorizedView skill →

multimodal-segment-anything

Foundation model for image segmentation with zero-shot transfer. Use when you need to segment any object in images using points, boxes, or masks as prompts, or automatically generate all object masks in an image.

[MultimodalImageSegmentationComputerVisionSAMZero-Shot]
UncategorizedView skill →

multimodal-stable-diffusion

State-of-the-art text-to-image generation with Stable Diffusion models via HuggingFace Diffusers. Use when generating images from text prompts, performing image-to-image translation, inpainting, or building custom diffusion pipelines.

UncategorizedView skill →

multimodal-whisper

OpenAI's general-purpose speech recognition model. Supports 99 languages, transcription, translation to English, and language identification. Six model sizes from tiny (39M params) to large (1550M params). Use for speech-to-text, podcast transcription, or multilingual audio processing. Best for robust, multilingual ASR.

[WhisperSpeechRecognitionASRMultimodalMultilingualOpenAISpeech-To-TextTranscriptionTranslationAudioProcessing]
UncategorizedView skill →

observability-langsmith

LLM observability platform for tracing, evaluation, and monitoring. Use when debugging LLM applications, evaluating model outputs against datasets, monitoring production systems, or building systematic testing pipelines for AI applications.

[ObservabilityLangSmithTracingEvaluationMonitoringDebuggingTestingLLMOpsProduction]
UncategorizedView skill →

observability-phoenix

Open-source AI observability platform for LLM tracing, evaluation, and monitoring. Use when debugging LLM applications with detailed traces, running evaluations on datasets, or monitoring production AI systems with real-time insights.

UncategorizedView skill →

optimization-awq

Activation-aware weight quantization for 4-bit LLM compression with 3x speedup and minimal accuracy loss. Use when deploying large models (7B-70B) on limited GPU memory, when you need faster inference than GPTQ with better accuracy preservation, or for instruction-tuned and multimodal models. MLSys 2024 Best Paper Award winner.

[OptimizationAWQQuantization4-BitActivation-AwareMemoryOptimizationFastInferencevLLMIntegrationMarlinKernels]
UncategorizedView skill →

optimization-bitsandbytes

Quantizes LLMs to 8-bit or 4-bit for 50-75% memory reduction with minimal accuracy loss. Use when GPU memory is limited, need to fit larger models, or want faster inference. Supports INT8, NF4, FP4 formats, QLoRA training, and 8-bit optimizers. Works with HuggingFace Transformers.

[OptimizationBitsandbytesQuantization8-Bit4-BitMemoryOptimizationQLoRANF4INT8HuggingFaceEfficientInference]
UncategorizedView skill →

optimization-flash-attention

Optimizes transformer attention with Flash Attention for 2-4x speedup and 10-20x memory reduction. Use when training/running transformers with long sequences (>512 tokens), encountering GPU memory issues with attention, or need faster inference. Supports PyTorch native SDPA, flash-attn library, H100 FP8, and sliding window attention.

[OptimizationFlashAttentionAttentionOptimizationMemoryEfficiencySpeedOptimizationLongContextPyTorchSDPAH100FP8Transformers]
UncategorizedView skill →

optimization-gguf

GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU requirements.

[GGUFQuantizationllama.cppCPUInferenceAppleSiliconModelCompressionOptimization]
UncategorizedView skill →

optimization-gptq

Post-training 4-bit quantization for LLMs with minimal accuracy loss. Use for deploying large models (70B, 405B) on consumer GPUs, when you need 4× memory reduction with <2% perplexity degradation, or for faster inference (3-4× speedup) vs FP16. Integrates with transformers and PEFT for QLoRA fine-tuning.

[OptimizationGPTQQuantization4-BitPost-TrainingMemoryOptimizationConsumerGPUsFastInferenceQLoRAGroup-WiseQuantization]
UncategorizedView skill →

optimization-hqq

Half-Quadratic Quantization for LLMs without calibration data. Use when quantizing models to 4/3/2-bit precision without needing calibration datasets, for fast quantization workflows, or when deploying with vLLM or HuggingFace Transformers.

[QuantizationHQQOptimizationMemoryEfficiencyInferenceModelCompression]
UncategorizedView skill →

parallel-agents

Multi-agent orchestration patterns. Use when multiple independent tasks can run with different domain expertise or when comprehensive analysis requires multiple perspectives.

UncategorizedView skill →

perplexity

Web search and research using Perplexity AI. Use when user says "search", "find", "look up", "ask", "research", or "what's the latest" for generic queries. NOT for library/framework docs (use Context7) or workspace questions.

UncategorizedView skill →

post-training-grpo-rl-training

Expert guidance for GRPO/RL fine-tuning with TRL for reasoning and task-specific model training

[Post-TrainingReinforcementLearningGRPOTRLRLHFRewardModelingReasoningDPOPPOStructuredOutput]
UncategorizedView skill →

post-training-miles

Provides guidance for enterprise-grade RL training using miles, a production-ready fork of slime. Use when training large MoE models with FP8/INT4, needing train-inference alignment, or requiring speculative RL for maximum throughput.

[ReinforcementLearningMoEFP8INT4EnterpriseSGLangMegatron-LM]
UncategorizedView skill →

post-training-openrlhf

High-performance RLHF framework with Ray+vLLM acceleration. Use for PPO, GRPO, RLOO, DPO training of large models (7B-70B+). Built on Ray, vLLM, ZeRO-3. 2× faster than DeepSpeedChat with distributed architecture and GPU resource sharing.

UncategorizedView skill →

post-training-simpo

Simple Preference Optimization for LLM alignment. Reference-free alternative to DPO with better performance (+6.4 points on AlpacaEval 2.0). No reference model needed, more efficient than DPO. Use for preference alignment when want simpler, faster training than DPO/PPO.

[Post-TrainingSimPOPreferenceOptimizationAlignmentDPOAlternativeReference-FreeLLMAlignmentEfficientTraining]
UncategorizedView skill →

post-training-slime

Provides guidance for LLM post-training with RL using slime, a Megatron+SGLang framework. Use when training GLM models, implementing custom data generation workflows, or needing tight Megatron-LM integration for RL scaling.

[ReinforcementLearningMegatron-LMSGLangGRPOPost-TrainingGLM]
UncategorizedView skill →

post-training-torchforge

Provides guidance for PyTorch-native agentic RL using torchforge, Meta's library separating infra from algorithms. Use when you want clean RL abstractions, easy algorithm experimentation, or scalable training with Monarch and TorchTitan.

[ReinforcementLearningPyTorchGRPOSFTMonarchTorchTitanMeta]
UncategorizedView skill →

post-training-trl-fine-tuning

Fine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GRPO for reward optimization, and reward model training. Use when need RLHF, align model with preferences, or train from human feedback. Works with HuggingFace Transformers.

[Post-TrainingTRLReinforcementLearningFine-TuningSFTDPOPPOGRPORLHFPreferenceAlignmentHuggingFace]
UncategorizedView skill →

post-training-verl

Provides guidance for training LLMs with reinforcement learning using verl (Volcano Engine RL). Use when implementing RLHF, GRPO, PPO, or other RL algorithms for LLM post-training at scale with flexible infrastructure backends.

[ReinforcementLearningRLHFGRPOPPOPost-TrainingDistributedTraining]
UncategorizedView skill →

prompt-caching

Caching strategies for LLM prompts including Anthropic prompt caching, response caching, and CAG (Cache Augmented Generation) Use when: prompt caching, cache prompt, response cache, cag, cache augmented.

UncategorizedView skill →

Page 2 of 7 · 336 results