Back to tags
Tag

Agent Skills with tag: DeepSpeed

9 skills match this tag. Use tags to discover related Agent Skills and explore similar workflows.

distributed-training-accelerate

Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). Interactive config, single launch command. HuggingFace ecosystem standard.

[DistributedTrainingHuggingFaceAccelerate
Orchestra Research
Orchestra Research
33,1943,891

distributed-training-pytorch-lightning

High-level PyTorch framework with Trainer class, automatic distributed training (DDP/FSDP/DeepSpeed), callbacks system, and minimal boilerplate. Scales from laptop to supercomputer with same code. Use when you want clean training loops with built-in best practices.

[PyTorchLightningTrainingFramework
Orchestra Research
Orchestra Research
33,1943,891

emerging-techniques-moe-training

Train Mixture of Experts (MoE) models using DeepSpeed or HuggingFace. Use when training large-scale models with limited compute (5× cost reduction vs dense models), implementing sparse architectures like Mixtral 8x7B or DeepSeek-V3, or scaling model capacity without proportional compute increase. Covers MoE architectures, routing mechanisms, load balancing, expert parallelism, and inference optimization.

[EmergingTechniquesMoEMixture
Orchestra Research
Orchestra Research
33,1943,891

axolotl

Axolotl: YAML LLM fine-tuning (LoRA, DPO, GRPO).

[Fine-TuningAxolotlLLMLoRA
poorrican
poorrican
0

huggingface-accelerate

Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). Interactive config, single launch command. HuggingFace ecosystem standard.

[DistributedTrainingHuggingFaceAccelerate
poorrican
poorrican
0

pytorch-lightning

High-level PyTorch framework with Trainer class, automatic distributed training (DDP/FSDP/DeepSpeed), callbacks system, and minimal boilerplate. Scales from laptop to supercomputer with same code. Use when you want clean training loops with built-in best practices.

[PyTorchLightningTrainingFramework
poorrican
poorrican
0

axolotl

Axolotl: YAML LLM fine-tuning (LoRA, DPO, GRPO).

[Fine-TuningAxolotlLLMLoRA
PoorRican
PoorRican
0

huggingface-accelerate

Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). Interactive config, single launch command. HuggingFace ecosystem standard.

[DistributedTrainingHuggingFaceAccelerate
PoorRican
PoorRican
0

pytorch-lightning

High-level PyTorch framework with Trainer class, automatic distributed training (DDP/FSDP/DeepSpeed), callbacks system, and minimal boilerplate. Scales from laptop to supercomputer with same code. Use when you want clean training loops with built-in best practices.

[PyTorchLightningTrainingFramework
PoorRican
PoorRican
0