Back to tags
Tag

Agent Skills with tag: PyTorch

18 skills match this tag. Use tags to discover related Agent Skills and explore similar workflows.

data-processing-ray-data

Scalable data processing for ML workloads. Streaming execution across CPU/GPU, supports Parquet/CSV/JSON/images. Integrates with Ray Train, PyTorch, TensorFlow. Scales from single machine to 100s of nodes. Use for batch inference, data preprocessing, multi-modal data loading, or distributed ETL pipelines.

[DataProcessingRayData
Orchestra Research
Orchestra Research
33,1943,891

distributed-training-accelerate

Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). Interactive config, single launch command. HuggingFace ecosystem standard.

[DistributedTrainingHuggingFaceAccelerate
Orchestra Research
Orchestra Research
33,1943,891

distributed-training-pytorch-fsdp

Expert guidance for Fully Sharded Data Parallel training with PyTorch FSDP - parameter sharding, mixed precision, CPU offloading, FSDP2

[DistributedTrainingPyTorchFSDP
Orchestra Research
Orchestra Research
33,1943,891

distributed-training-ray-train

Distributed training orchestration across clusters. Scales PyTorch/TensorFlow/HuggingFace from laptop to 1000s of nodes. Built-in hyperparameter tuning with Ray Tune, fault tolerance, elastic scaling. Use when training massive models across multiple machines or running distributed hyperparameter sweeps.

[RayTrainDistributedTraining
Orchestra Research
Orchestra Research
33,1943,891

mlops-mlflow

Track ML experiments, manage model registry with versioning, deploy models to production, and reproduce experiments with MLflow - framework-agnostic ML lifecycle platform

[MLOpsMLflowExperimentTracking
Orchestra Research
Orchestra Research
33,1943,891

mlops-tensorboard

Visualize training metrics, debug models with histograms, compare experiments, visualize model graphs, and profile performance with TensorBoard - Google's ML visualization toolkit

[MLOpsTensorBoardVisualizationTraining
Orchestra Research
Orchestra Research
33,1943,891

mlops-weights-and-biases

Track ML experiments with automatic logging, visualize training in real-time, optimize hyperparameters with sweeps, and manage model registry with W&B - collaborative MLOps platform

[MLOpsWeightsAndBiases
Orchestra Research
Orchestra Research
33,1943,891

optimization-flash-attention

Optimizes transformer attention with Flash Attention for 2-4x speedup and 10-20x memory reduction. Use when training/running transformers with long sequences (>512 tokens), encountering GPU memory issues with attention, or need faster inference. Supports PyTorch native SDPA, flash-attn library, H100 FP8, and sliding window attention.

[OptimizationFlashAttentionAttention
Orchestra Research
Orchestra Research
33,1943,891

post-training-torchforge

Provides guidance for PyTorch-native agentic RL using torchforge, Meta's library separating infra from algorithms. Use when you want clean RL abstractions, easy algorithm experimentation, or scalable training with Monarch and TorchTitan.

[ReinforcementLearningPyTorchGRPO
Orchestra Research
Orchestra Research
33,1943,891

weights-and-biases

W&B: log ML experiments, sweeps, model registry, dashboards.

[MLOpsWeightsAndBiases
delorenj
delorenj
176

weights-and-biases

W&B: log ML experiments, sweeps, model registry, dashboards.

[MLOpsWeightsAndBiases
poorrican
poorrican
0

huggingface-accelerate

Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). Interactive config, single launch command. HuggingFace ecosystem standard.

[DistributedTrainingHuggingFaceAccelerate
poorrican
poorrican
0

optimizing-attention-flash

Optimizes transformer attention with Flash Attention for 2-4x speedup and 10-20x memory reduction. Use when training/running transformers with long sequences (>512 tokens), encountering GPU memory issues with attention, or need faster inference. Supports PyTorch native SDPA, flash-attn library, H100 FP8, and sliding window attention.

[OptimizationFlashAttentionAttention
poorrican
poorrican
0

pytorch-fsdp

Expert guidance for Fully Sharded Data Parallel training with PyTorch FSDP - parameter sharding, mixed precision, CPU offloading, FSDP2

[DistributedTrainingPyTorchFSDP
poorrican
poorrican
0

weights-and-biases

W&B: log ML experiments, sweeps, model registry, dashboards.

[MLOpsWeightsAndBiases
PoorRican
PoorRican
0

huggingface-accelerate

Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). Interactive config, single launch command. HuggingFace ecosystem standard.

[DistributedTrainingHuggingFaceAccelerate
PoorRican
PoorRican
0

optimizing-attention-flash

Optimizes transformer attention with Flash Attention for 2-4x speedup and 10-20x memory reduction. Use when training/running transformers with long sequences (>512 tokens), encountering GPU memory issues with attention, or need faster inference. Supports PyTorch native SDPA, flash-attn library, H100 FP8, and sliding window attention.

[OptimizationFlashAttentionAttention
PoorRican
PoorRican
0

pytorch-fsdp

Expert guidance for Fully Sharded Data Parallel training with PyTorch FSDP - parameter sharding, mixed precision, CPU offloading, FSDP2

[DistributedTrainingPyTorchFSDP
PoorRican
PoorRican
0