mlops-mlflow
Track ML experiments, manage model registry with versioning, deploy models to production, and reproduce experiments with MLflow - framework-agnostic ML lifecycle platform
mlops-weights-and-biases
Track ML experiments with automatic logging, visualize training in real-time, optimize hyperparameters with sweeps, and manage model registry with W&B - collaborative MLOps platform
post-training-trl-fine-tuning
Fine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GRPO for reward optimization, and reward model training. Use when need RLHF, align model with preferences, or train from human feedback. Works with HuggingFace Transformers.
weights-and-biases
W&B: log ML experiments, sweeps, model registry, dashboards.
weights-and-biases
W&B: log ML experiments, sweeps, model registry, dashboards.
fine-tuning-with-trl
TRL: SFT, DPO, PPO, GRPO, reward modeling for LLM RLHF.
weights-and-biases
W&B: log ML experiments, sweeps, model registry, dashboards.
fine-tuning-with-trl
TRL: SFT, DPO, PPO, GRPO, reward modeling for LLM RLHF.