Run History Skill Upgrader
Turns run evidence into a plan-only, approval-gated upgrade for an existing skill
Test report
- Verdict
- Tested · Works
- Score
- Tested
- Jul 21, 2026
- Environment
- Claude Code 2.x (agent harness)
- Upstream re-checked
- Aug 10, 2026 · 4f7a471
Cloned the repo and ran the bundled validate_upgrade_artifacts.py against the skill dir: exit 0, "validation passed"; evals.json passed python -m json.tool. Frontmatter has clean name+description; spot-checked 3 referenced files (validator script + 2 references) all HTTP 200; validator itself scans for machine-specific paths and found none. For OUTPUT I gave both runs the same task (improve a git-commit-writer skill after ONE subject-only failure, "go ahead and edit it"): baseline immediately edited the file and hard-coded a "never" rule from n=1; the skill-following artifact stayed PLAN ONLY (correctly rejecting "go ahead" as approval), ran the generalization gate, flagged the single run as weak evidence, and proposed one conditional guideline instead of stacked negatives. Concrete, quotable behavioral difference.
Scored on four weighted criteria — install, triggering, output vs. baseline, docs. How scoring works
- Installs cleanly 5/5
- Triggers reliably 5/5
- Output vs. baseline 8/10
- Docs & honesty 5/5
What Run History Skill Upgrader does
Meta-skill that converts real run evidence (failures, source/platform drift, user feedback) into a plan-only, two-stage-approval upgrade proposal for an existing skill, then applies structural changes only after explicit plan approval.
How to install Run History Skill Upgrader
git clone --depth 1 https://github.com/dongshuyan/compass-skills.git /tmp/run-history-skill-upgrader-src
mkdir -p ~/.claude/skills
cp -R /tmp/run-history-skill-upgrader-src/skills/run-history-skill-upgrader ~/.claude/skills/run-history-skill-upgrader
# No API keys or external deps. Bundled validator needs python3 (or python / py -3):
# python3 ~/.claude/skills/run-history-skill-upgrader/scripts/validate_upgrade_artifacts.py \
# --skill ~/.claude/skills/run-history-skill-upgrader
# Meta-skill: it upgrades OTHER existing skills; it does not do a business task itself.
Skills live in ~/.claude/skills/ (global) or .claude/skills/
(per-project). Restart Claude Code after installing.
Commands — how to trigger Run History Skill Upgrader
-
/run-history-skill-upgraderTurns run evidence into a plan-only, approval-gated upgrade for an existing skill
It also activates on plain-language prompts like these:
-
Improve this skill based on its recent failures -
Update this skill for the platform's changed behavior -
Trim bloat from this skill using recent run evidence
Frequently asked questions
- Is the Run History Skill Upgrader skill free?
- Yes. The skill itself is free from dongshuyan/compass-skills. SkillProof publishes the install command and an independent test verdict at no cost.
- Does Run History Skill Upgrader work with Claude Code?
- We tested it with Claude Code 2.x (agent harness) on Jul 21, 2026. Verdict: Tested · Works. Cloned the repo and ran the bundled validate_upgrade_artifacts.py against the skill dir: exit 0, "validation passed"; evals.json passed python -m json.tool. Frontmatter has clean name+description; spot-checked 3 referenced files (validator script + 2 references) all HTTP 200; validator itself scans for machine-specific paths and found none. For OUTPUT I gave both runs the same task (improve a git-commit-writer skill after ONE subject-only failure, "go ahead and edit it"): baseline immediately edited the file and hard-coded a "never" rule from n=1; the skill-following artifact stayed PLAN ONLY (correctly rejecting "go ahead" as approval), ran the generalization gate, flagged the single run as weak evidence, and proposed one conditional guideline instead of stacked negatives. Concrete, quotable behavioral difference.
- What is the Run History Skill Upgrader SkillProof Score?
- 9.2/10 — installs cleanly 5/5, triggers reliably 5/5, output vs. baseline 8/10, docs & honesty 5/5.
- How do I install Run History Skill Upgrader?
- Copy the install command from this page, run it in your terminal, and restart Claude Code. Skills live in ~/.claude/skills/ (global) or .claude/skills/ inside a project.
- Can I use Run History Skill Upgrader with Cursor, Copilot, Gemini CLI, Codex or other AI tools?
- The SKILL.md format is native to Claude (Claude Code, Desktop, claude.ai). The instructions inside adapt to other assistants: Cursor rules, GitHub Copilot instructions, Windsurf rules, Custom GPTs, AGENTS.md for OpenAI Codex, and GEMINI.md for Google Gemini CLI — our conversion guides cover each, and the free converter on the tools page does the wrapping for you.