SkillProof tested Claude skills

Optimize Skill

Eval-gated loop to improve a skill's SKILL.md without regressions

Af Bennyoooo · Bennyoooo/skillmaxxing

Tested · Didn't pass

Optimize Skill — Eval-gated loop to improve a skill's SKILL.md without regressions

Hvad det gør

Runs a rollout-score-reflect-apply-validate-promote loop against an existing skill's eval.yaml, capping edits per step and blocking promotion unless a candidate strictly beats the current version with no held-out regression. Triggers when a skill underperforms or the user asks to optimize/tune/improve a skill that already has an eval set.

Testrapport

Copying just the skill folder (the only GitHub-only install path available) leaves scripts/optimize.sh unresolved — verified with a real install: `bash scripts/optimize.sh score ...` from inside the copied skill dir exits 127, 'No such file or directory', because the actual script lives one level up at skill-maxing-plugin/scripts/, not inside optimize-skill/.

Testet: 2026-07-15 · Claude Code 2.x (agent harness)

Installation

git clone https://github.com/Bennyoooo/skillmaxxing
cd skillmaxxing
mkdir -p ~/.claude/skills
cp -r skill-maxing-plugin/skills/optimize-skill ~/.claude/skills/optimize-skill

Kommandoer og eksempelprompter

  • /optimize-skillEval-gated loop to improve a skill's SKILL.md without regressions

Skills udløses af almindelige forespørgsler — ingen kommandoer at huske. Efter installationen aktiverer prompter som disse skillen (på engelsk):

  • My PR-review skill has an eval.yaml but keeps failing one test case
  • Optimize this skill's prompt against its eval set without breaking passing cases
  • This skill scores badly on its evals, improve it without regressing the rest

Læs hele rapporten →