Optimise Skill
Vendors Microsoft's SkillOpt/OPRO engine to retrain one skill's judge-shaped rubric against a labelled outcome corpus, gated by a held-out set.
Test report
- Verdict
- Tested · Works
- Score
- Tested
- Jul 15, 2026
- Environment
- Claude Code 2.x (agent harness)
- Upstream re-checked
- Jul 18, 2026 · 8efd653
Actually ran it: scripts/setup.py --apply scaffolded a real 9-file optimisation/ contract (manifest, rubric, train/val/test corpus dirs, holdout incident/reversal fixtures, ledger) for a throwaway consumer, validate_manifest.py passed it clean, and the full 206-test suite passed instantly with stub judges and zero LLM calls, exactly matching the README's own verified claim. Did not run the live LLM training loop itself since that shells out to a real claude -p subscription call.
Scored on four weighted criteria — install, triggering, output vs. baseline, docs. How scoring works
- Installs cleanly 5/5
- Triggers reliably 5/5
- Output vs. baseline 8/10
- Docs & honesty 5/5
What Optimise Skill does
A decision-policy optimiser for Claude skills: given a manifest, a single tunable rubric document, and a labelled markdown corpus of past decisions, it runs SkillOpt's rollout/reflect/edit/gate loop and only promotes an edited rubric when it strictly beats baseline on an adversarial held-out set. Triggers on 'train/optimise the <X> rubric' or the /optimise-skill <consumer> command; explicitly out of scope for tuning a skill's triggering description, which stays with skill-creator. Live tuning shells out to the claude CLI against a Claude Max subscription (or an OpenAI key as an alternate provider).
How to install Optimise Skill
git clone https://github.com/yungbose/upskill.git
cd upskill
mkdir -p ~/.claude/skills
cp -r optimise-skill ~/.claude/skills/optimise-skill
pip install -r optimise-skill/requirements.txt # PyYAML only; live tuning additionally needs the claude CLI + a Claude Max subscription
Skills live in ~/.claude/skills/ (global) or .claude/skills/
(per-project). Restart Claude Code after installing.
Commands — how to trigger Optimise Skill
-
/optimise-skillVendors Microsoft's SkillOpt/OPRO engine to retrain one skill's judge-shaped rubric against a labelled outcome corpus, gated by a held-out set.
It also activates on plain-language prompts like these:
-
train this skill's rubric against our labeled decision corpus -
optimize the judge rubric and validate it on a held-out test set -
scaffold a new optimisation consumer and run its test suite
Frequently asked questions
- Is the Optimise Skill skill free?
- Yes. The skill itself is free from yungbose/upskill. SkillProof publishes the install command and an independent test verdict at no cost.
- Does Optimise Skill work with Claude Code?
- We tested it with Claude Code 2.x (agent harness) on Jul 15, 2026. Verdict: Tested · Works. Actually ran it: scripts/setup.py --apply scaffolded a real 9-file optimisation/ contract (manifest, rubric, train/val/test corpus dirs, holdout incident/reversal fixtures, ledger) for a throwaway consumer, validate_manifest.py passed it clean, and the full 206-test suite passed instantly with stub judges and zero LLM calls, exactly matching the README's own verified claim. Did not run the live LLM training loop itself since that shells out to a real claude -p subscription call.
- What is the Optimise Skill SkillProof Score?
- 9.2/10 — installs cleanly 5/5, triggers reliably 5/5, output vs. baseline 8/10, docs & honesty 5/5.
- How do I install Optimise Skill?
- Copy the install command from this page, run it in your terminal, and restart Claude Code. Skills live in ~/.claude/skills/ (global) or .claude/skills/ inside a project.
- Can I use Optimise Skill with Cursor, Copilot, Gemini CLI, Codex or other AI tools?
- The SKILL.md format is native to Claude (Claude Code, Desktop, claude.ai). The instructions inside adapt to other assistants: Cursor rules, GitHub Copilot instructions, Windsurf rules, Custom GPTs, AGENTS.md for OpenAI Codex, and GEMINI.md for Google Gemini CLI — our conversion guides cover each, and the free converter on the tools page does the wrapping for you.