Optimize a skill's description through iterative eval-and-improve cycles.
$ARGUMENTS
If $ARGUMENTS is provided, use it as the skill path. Otherwise, ask the user which skill to optimize.
Steps
-
Locate the skill directory. Resolve
$ARGUMENTSto an absolute path if provided. -
Check for eval queries in
.skill-eval/evals/-- if missing, scaffold them first. -
Ask the user to review trigger queries in
eval_review.html(generated by the skill-eval pipeline). -
Run the optimization loop:
python3 ${SKILL_ROOT}/../skill-shaper/scripts/run_loop.py \ --eval-set <queries> \ --skill-path <dir> \ --max-iterations 5 \ --holdout 0.4 -
Open the live HTML report (
generate_report.py) showing iteration progress. -
When complete, display the best description and its test score.
-
Ask the user to confirm before applying the new description to SKILL.md.