Back to tags
Tag

Agent Skills with tag: CPU

10 skills match this tag. Use tags to discover related Agent Skills and explore similar workflows.

distributed-training-pytorch-fsdp

Expert guidance for Fully Sharded Data Parallel training with PyTorch FSDP - parameter sharding, mixed precision, CPU offloading, FSDP2

[DistributedTrainingPyTorchFSDP
Orchestra Research
Orchestra Research
33,1943,891

inference-serving-llama-cpp

Runs LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. Use for edge deployment, M1/M2/M3 Macs, AMD/Intel GPUs, or when CUDA is unavailable. Supports GGUF quantization (1.5-8 bit) for reduced memory and 4-10× speedup vs PyTorch on CPU.

[InferenceServingLlama.cppCPU
Orchestra Research
Orchestra Research
33,1943,891

optimization-gguf

GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU requirements.

[GGUFQuantizationllama.cppCPU
Orchestra Research
Orchestra Research
33,1943,891

llama-cpp

llama.cpp local GGUF inference + HF Hub model discovery.

[llama.cppGGUFQuantizationHugging
delorenj
delorenj
176

gguf-quantization

GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU requirements.

[GGUFQuantizationllama.cppCPU
poorrican
poorrican
0

llama-cpp

llama.cpp local GGUF inference + HF Hub model discovery.

[llama.cppGGUFQuantizationHugging
poorrican
poorrican
0

pytorch-fsdp

Expert guidance for Fully Sharded Data Parallel training with PyTorch FSDP - parameter sharding, mixed precision, CPU offloading, FSDP2

[DistributedTrainingPyTorchFSDP
poorrican
poorrican
0

gguf-quantization

GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU requirements.

[GGUFQuantizationllama.cppCPU
PoorRican
PoorRican
0

llama-cpp

llama.cpp local GGUF inference + HF Hub model discovery.

[llama.cppGGUFQuantizationHugging
PoorRican
PoorRican
0

pytorch-fsdp

Expert guidance for Fully Sharded Data Parallel training with PyTorch FSDP - parameter sharding, mixed precision, CPU offloading, FSDP2

[DistributedTrainingPyTorchFSDP
PoorRican
PoorRican
0