Back to tags
Tag

Agent Skills with tag: Models

6 skills match this tag. Use tags to discover related Agent Skills and explore similar workflows.

emerging-techniques-moe-training

Train Mixture of Experts (MoE) models using DeepSpeed or HuggingFace. Use when training large-scale models with limited compute (5× cost reduction vs dense models), implementing sparse architectures like Mixtral 8x7B or DeepSeek-V3, or scaling model capacity without proportional compute increase. Covers MoE architectures, routing mechanisms, load balancing, expert parallelism, and inference optimization.

[EmergingTechniquesMoEMixture
Orchestra Research
Orchestra Research
33,1943,891

emerging-techniques-speculative-decoding

Accelerate LLM inference using speculative decoding, Medusa multiple heads, and lookahead decoding techniques. Use when optimizing inference speed (1.5-3.6× speedup), reducing latency for real-time applications, or deploying models with limited compute. Covers draft models, tree-based attention, Jacobi iteration, parallel token generation, and production deployment strategies.

[EmergingTechniquesSpeculativeDecoding
Orchestra Research
Orchestra Research
33,1943,891

model-architecture-mamba

State-space model with O(n) complexity vs Transformers' O(n²). 5× faster inference, million-token sequences, no KV cache. Selective SSM with hardware-aware design. Mamba-1 (d_state=16) and Mamba-2 (d_state=128, multi-head). Models 130M-2.8B on HuggingFace.

[ModelArchitectureMambaState
Orchestra Research
Orchestra Research
33,1943,891

rag-sentence-transformers

Framework for state-of-the-art sentence, text, and image embeddings. Provides 5000+ pre-trained models for semantic similarity, clustering, and retrieval. Supports multilingual, domain-specific, and multimodal models. Use for generating embeddings for RAG, semantic search, or similarity tasks. Best for production embedding generation.

[SentenceTransformersEmbeddingsSemantic
Orchestra Research
Orchestra Research
33,1943,891

outlines

Outlines: structured JSON/regex/Pydantic LLM generation.

[PromptEngineeringOutlinesStructured
poorrican
poorrican
0

outlines

Outlines: structured JSON/regex/Pydantic LLM generation.

[PromptEngineeringOutlinesStructured
PoorRican
PoorRican
0