Back to tags
Tag

Agent Skills with tag: Llama

7 skills match this tag. Use tags to discover related Agent Skills and explore similar workflows.

fine-tuning-llama-factory

Expert guidance for fine-tuning LLMs with LLaMA-Factory - WebUI no-code, 100+ models, 2/3/4/5/6/8-bit QLoRA, multimodal support

[Fine-TuningLLaMAFactoryLLM
Orchestra Research
Orchestra Research
33,1943,891

model-architecture-litgpt

Implements and trains LLMs using Lightning AI's LitGPT with 20+ pretrained architectures (Llama, Gemma, Phi, Qwen, Mistral). Use when need clean model implementations, educational understanding of architectures, or production fine-tuning with LoRA/QLoRA. Single-file implementations, no abstraction layers.

[ModelArchitectureLitGPTLightning
Orchestra Research
Orchestra Research
33,1943,891

model-architecture-torchtitan

Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing.

[ModelArchitectureDistributedTraining
Orchestra Research
Orchestra Research
33,1943,891

distributed-llm-pretraining-torchtitan

Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing.

[ModelArchitectureDistributedTraining
poorrican
poorrican
0

unsloth

Unsloth: 2-5x faster LoRA/QLoRA fine-tuning, less VRAM.

[Fine-TuningUnslothFastTraining
poorrican
poorrican
0

distributed-llm-pretraining-torchtitan

Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing.

[ModelArchitectureDistributedTraining
PoorRican
PoorRican
0

unsloth

Unsloth: 2-5x faster LoRA/QLoRA fine-tuning, less VRAM.

[Fine-TuningUnslothFastTraining
PoorRican
PoorRican
0