Back to tags
Tag

Agent Skills with tag: Architecture

10 skills match this tag. Use tags to discover related Agent Skills and explore similar workflows.

model-architecture-litgpt

Implements and trains LLMs using Lightning AI's LitGPT with 20+ pretrained architectures (Llama, Gemma, Phi, Qwen, Mistral). Use when need clean model implementations, educational understanding of architectures, or production fine-tuning with LoRA/QLoRA. Single-file implementations, no abstraction layers.

[ModelArchitectureLitGPTLightning
Orchestra Research
Orchestra Research
33,1943,891

model-architecture-mamba

State-space model with O(n) complexity vs Transformers' O(n²). 5× faster inference, million-token sequences, no KV cache. Selective SSM with hardware-aware design. Mamba-1 (d_state=16) and Mamba-2 (d_state=128, multi-head). Models 130M-2.8B on HuggingFace.

[ModelArchitectureMambaState
Orchestra Research
Orchestra Research
33,1943,891

model-architecture-nanogpt

Educational GPT implementation in ~300 lines. Reproduces GPT-2 (124M) on OpenWebText. Clean, hackable code for learning transformers. By Andrej Karpathy. Perfect for understanding GPT architecture from scratch. Train on Shakespeare (CPU) or OpenWebText (multi-GPU).

[ModelArchitectureNanoGPTGPT-2
Orchestra Research
Orchestra Research
33,1943,891

model-architecture-rwkv

RNN+Transformer hybrid with O(n) inference. Linear time, infinite context, no KV cache. Train like GPT (parallel), infer like RNN (sequential). Linux Foundation AI project. Production at Windows, Office, NeMo. RWKV-7 (March 2025). Models up to 14B parameters.

[RWKVModelArchitectureRNN
Orchestra Research
Orchestra Research
33,1943,891

model-architecture-torchtitan

Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing.

[ModelArchitectureDistributedTraining
Orchestra Research
Orchestra Research
33,1943,891

excalidraw

Hand-drawn Excalidraw JSON diagrams (arch, flow, seq).

[ExcalidrawDiagramsFlowchartsArchitecture
delorenj
delorenj
176

excalidraw

Hand-drawn Excalidraw JSON diagrams (arch, flow, seq).

[ExcalidrawDiagramsFlowchartsArchitecture
poorrican
poorrican
0

distributed-llm-pretraining-torchtitan

Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing.

[ModelArchitectureDistributedTraining
poorrican
poorrican
0

distributed-llm-pretraining-torchtitan

Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing.

[ModelArchitectureDistributedTraining
PoorRican
PoorRican
0

excalidraw

Hand-drawn Excalidraw JSON diagrams (arch, flow, seq).

[ExcalidrawDiagramsFlowchartsArchitecture
PoorRican
PoorRican
0