SkillProof tested Claude skills

Optimize Skill

Eval-gated loop to improve a skill's SKILL.md without regressions

Door Bennyoooo · Bennyoooo/skillmaxxing

Tested · Didn't pass

Optimize Skill — Eval-gated loop to improve a skill's SKILL.md without regressions

Wat het doet

Runs a rollout-score-reflect-apply-validate-promote loop against an existing skill's eval.yaml, capping edits per step and blocking promotion unless a candidate strictly beats the current version with no held-out regression. Triggers when a skill underperforms or the user asks to optimize/tune/improve a skill that already has an eval set.

Testrapport

Copying just the skill folder (the only GitHub-only install path available) leaves scripts/optimize.sh unresolved — verified with a real install: `bash scripts/optimize.sh score ...` from inside the copied skill dir exits 127, 'No such file or directory', because the actual script lives one level up at skill-maxing-plugin/scripts/, not inside optimize-skill/.

Getest op: 2026-07-15 · Claude Code 2.x (agent harness)

Installatie

git clone https://github.com/Bennyoooo/skillmaxxing
cd skillmaxxing
mkdir -p ~/.claude/skills
cp -r skill-maxing-plugin/skills/optimize-skill ~/.claude/skills/optimize-skill

Commando's en voorbeeldprompts

  • /optimize-skillEval-gated loop to improve a skill's SKILL.md without regressions

Skills reageren op gewone verzoeken — geen commando's om te onthouden. Na installatie activeren prompts zoals deze de skill (in het Engels):

  • My PR-review skill has an eval.yaml but keeps failing one test case
  • Optimize this skill's prompt against its eval set without breaking passing cases
  • This skill scores badly on its evals, improve it without regressing the rest

Volledig rapport (Engels) →