Back to tags
Tag

Agent Skills with tag: QLoRA

11 skills match this tag. Use tags to discover related Agent Skills and explore similar workflows.

fine-tuning-llama-factory

Expert guidance for fine-tuning LLMs with LLaMA-Factory - WebUI no-code, 100+ models, 2/3/4/5/6/8-bit QLoRA, multimodal support

[Fine-TuningLLaMAFactoryLLM
Orchestra Research
Orchestra Research
33,1943,891

fine-tuning-peft

Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when you need to train <1% of parameters with minimal accuracy loss, or for multi-adapter serving. HuggingFace's official library integrated with transformers ecosystem.

[Fine-TuningPEFTLoRAQLoRA
Orchestra Research
Orchestra Research
33,1943,891

model-architecture-litgpt

Implements and trains LLMs using Lightning AI's LitGPT with 20+ pretrained architectures (Llama, Gemma, Phi, Qwen, Mistral). Use when need clean model implementations, educational understanding of architectures, or production fine-tuning with LoRA/QLoRA. Single-file implementations, no abstraction layers.

[ModelArchitectureLitGPTLightning
Orchestra Research
Orchestra Research
33,1943,891

optimization-bitsandbytes

Quantizes LLMs to 8-bit or 4-bit for 50-75% memory reduction with minimal accuracy loss. Use when GPU memory is limited, need to fit larger models, or want faster inference. Supports INT8, NF4, FP4 formats, QLoRA training, and 8-bit optimizers. Works with HuggingFace Transformers.

[OptimizationBitsandbytesQuantization8-Bit
Orchestra Research
Orchestra Research
33,1943,891

optimization-gptq

Post-training 4-bit quantization for LLMs with minimal accuracy loss. Use for deploying large models (70B, 405B) on consumer GPUs, when you need 4× memory reduction with <2% perplexity degradation, or for faster inference (3-4× speedup) vs FP16. Integrates with transformers and PEFT for QLoRA fine-tuning.

[OptimizationGPTQQuantization4-Bit
Orchestra Research
Orchestra Research
33,1943,891

axolotl

Axolotl: YAML LLM fine-tuning (LoRA, DPO, GRPO).

[Fine-TuningAxolotlLLMLoRA
poorrican
poorrican
0

peft-fine-tuning

Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when you need to train <1% of parameters with minimal accuracy loss, or for multi-adapter serving. HuggingFace's official library integrated with transformers ecosystem.

[Fine-TuningPEFTLoRAQLoRA
poorrican
poorrican
0

unsloth

Unsloth: 2-5x faster LoRA/QLoRA fine-tuning, less VRAM.

[Fine-TuningUnslothFastTraining
poorrican
poorrican
0

axolotl

Axolotl: YAML LLM fine-tuning (LoRA, DPO, GRPO).

[Fine-TuningAxolotlLLMLoRA
PoorRican
PoorRican
0

peft-fine-tuning

Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when you need to train <1% of parameters with minimal accuracy loss, or for multi-adapter serving. HuggingFace's official library integrated with transformers ecosystem.

[Fine-TuningPEFTLoRAQLoRA
PoorRican
PoorRican
0

unsloth

Unsloth: 2-5x faster LoRA/QLoRA fine-tuning, less VRAM.

[Fine-TuningUnslothFastTraining
PoorRican
PoorRican
0