Back to tags
Tag

Agent Skills with tag: Compression

5 skills match this tag. Use tags to discover related Agent Skills and explore similar workflows.

emerging-techniques-knowledge-distillation

Compress large language models using knowledge distillation from teacher to student models. Use when deploying smaller models with retained performance, transferring GPT-4 capabilities to open-source models, or reducing inference costs. Covers temperature scaling, soft targets, reverse KLD, logit distillation, and MiniLLM training strategies.

[EmergingTechniquesKnowledgeDistillation
Orchestra Research
Orchestra Research
33,1943,891

emerging-techniques-model-pruning

Reduce LLM size and accelerate inference using pruning techniques like Wanda and SparseGPT. Use when compressing models without retraining, achieving 50% sparsity with minimal accuracy loss, or enabling faster inference on hardware accelerators. Covers unstructured pruning, structured pruning, N:M sparsity, magnitude pruning, and one-shot methods.

[EmergingTechniquesModelPruning
Orchestra Research
Orchestra Research
33,1943,891

optimization-gguf

GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU requirements.

[GGUFQuantizationllama.cppCPU
Orchestra Research
Orchestra Research
33,1943,891

gguf-quantization

GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU requirements.

[GGUFQuantizationllama.cppCPU
poorrican
poorrican
0

gguf-quantization

GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU requirements.

[GGUFQuantizationllama.cppCPU
PoorRican
PoorRican
0