Agent Skills: eval-harness

Build evaluation harnesses for AI-assisted implementations — capability evals, regression tests, graders (exact-match, LLM-judge, code-exec, rubric), and standardized metrics (pass@k, accuracy, latency, cost). Use when the user wants to set up or run evals, benchmark agents/skills, create regression test suites for prompts or AI features, compare model/prompt variants, or measure implementation quality. Triggers on "set up evals", "create eval harness", "benchmark this skill", "regression test the prompt", "run evals", "/eval-harness", or any request to systematically measure AI output quality.

UncategorizedID: mhylle/claude-skills-collection/eval-harness

Install this agent skill to your local

pnpm dlx add-skill https://github.com/mhylle/claude-skills-collection/eval-harness

Skill Files

Browse the full folder contents for eval-harness.

Download Skill

Loading file tree…

Select a file to preview its contents.