Optimise Skill

Vendors Microsoft's SkillOpt/OPRO engine to retrain one skill's judge-shaped rubric against a labelled outcome corpus, gated by a held-out set.

Tested · Works

Test report

Verdict
Tested · Works
Score
9.2/10
Tested
Jul 15, 2026
Environment
Claude Code 2.x (agent harness)
Upstream re-checked
Jul 18, 2026 · 8efd653

Actually ran it: scripts/setup.py --apply scaffolded a real 9-file optimisation/ contract (manifest, rubric, train/val/test corpus dirs, holdout incident/reversal fixtures, ledger) for a throwaway consumer, validate_manifest.py passed it clean, and the full 206-test suite passed instantly with stub judges and zero LLM calls, exactly matching the README's own verified claim. Did not run the live LLM training loop itself since that shells out to a real claude -p subscription call.

Scored on four weighted criteria — install, triggering, output vs. baseline, docs. How scoring works

  • Installs cleanly 5/5
  • Triggers reliably 5/5
  • Output vs. baseline 8/10
  • Docs & honesty 5/5

What Optimise Skill does

A decision-policy optimiser for Claude skills: given a manifest, a single tunable rubric document, and a labelled markdown corpus of past decisions, it runs SkillOpt's rollout/reflect/edit/gate loop and only promotes an edited rubric when it strictly beats baseline on an adversarial held-out set. Triggers on 'train/optimise the <X> rubric' or the /optimise-skill <consumer> command; explicitly out of scope for tuning a skill's triggering description, which stays with skill-creator. Live tuning shells out to the claude CLI against a Claude Max subscription (or an OpenAI key as an alternate provider).

How to install Optimise Skill

git clone https://github.com/yungbose/upskill.git
cd upskill
mkdir -p ~/.claude/skills
cp -r optimise-skill ~/.claude/skills/optimise-skill
pip install -r optimise-skill/requirements.txt  # PyYAML only; live tuning additionally needs the claude CLI + a Claude Max subscription

Skills live in ~/.claude/skills/ (global) or .claude/skills/ (per-project). Restart Claude Code after installing.

Commands — how to trigger Optimise Skill

  • /optimise-skill Vendors Microsoft's SkillOpt/OPRO engine to retrain one skill's judge-shaped rubric against a labelled outcome corpus, gated by a held-out set.

It also activates on plain-language prompts like these:

  • train this skill's rubric against our labeled decision corpus
  • optimize the judge rubric and validate it on a held-out test set
  • scaffold a new optimisation consumer and run its test suite

Frequently asked questions

Is the Optimise Skill skill free?
Yes. The skill itself is free from yungbose/upskill. SkillProof publishes the install command and an independent test verdict at no cost.
Does Optimise Skill work with Claude Code?
We tested it with Claude Code 2.x (agent harness) on Jul 15, 2026. Verdict: Tested · Works. Actually ran it: scripts/setup.py --apply scaffolded a real 9-file optimisation/ contract (manifest, rubric, train/val/test corpus dirs, holdout incident/reversal fixtures, ledger) for a throwaway consumer, validate_manifest.py passed it clean, and the full 206-test suite passed instantly with stub judges and zero LLM calls, exactly matching the README's own verified claim. Did not run the live LLM training loop itself since that shells out to a real claude -p subscription call.
What is the Optimise Skill SkillProof Score?
9.2/10 — installs cleanly 5/5, triggers reliably 5/5, output vs. baseline 8/10, docs & honesty 5/5.
How do I install Optimise Skill?
Copy the install command from this page, run it in your terminal, and restart Claude Code. Skills live in ~/.claude/skills/ (global) or .claude/skills/ inside a project.
Can I use Optimise Skill with Cursor, Copilot, Gemini CLI, Codex or other AI tools?
The SKILL.md format is native to Claude (Claude Code, Desktop, claude.ai). The instructions inside adapt to other assistants: Cursor rules, GitHub Copilot instructions, Windsurf rules, Custom GPTs, AGENTS.md for OpenAI Codex, and GEMINI.md for Google Gemini CLI — our conversion guides cover each, and the free converter on the tools page does the wrapping for you.