Ablation Planner

Codex-designed ablation study plans for ML papers, vetted for feasibility by Claude Code.

Works with setup

Test report

Verdict
Works with setup
Score
8.0/10
Tested
Jul 10, 2026
Environment
Claude Code 2.x (agent harness)
Upstream re-checked
Aug 10, 2026 · bf421af

Its headline mechanic hands design work to a Codex tool that wasn't available in this environment, so that step had to be simulated by hand - real friction for anyone without Codex configured.

Scored on four weighted criteria — install, triggering, output vs. baseline, docs. How scoring works

  • Installs cleanly 4/5
  • Triggers reliably 5/5
  • Output vs. baseline 7/10
  • Docs & honesty 4/5

What Ablation Planner does

Ablation-planner has Codex act as a critical peer reviewer to design ablation studies that isolate each novel component, sweep key hyperparameters, and pre-answer likely reviewer questions, while Claude Code checks compute feasibility and implements the runs. It's meant to trigger after main results pass the companion result-to-claim skill (claim_supported=yes/partial), or whenever a user explicitly asks to plan ablations for a paper submission. It hard-depends on the mcp__codex__codex MCP tool for the core design step; without that tool configured, the documented dual-agent workflow cannot run as written.

How to install Ablation Planner

git clone https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep
cd Auto-claude-code-research-in-sleep
mkdir -p ~/.claude/skills
cp -r skills/ablation-planner ~/.claude/skills/ablation-planner

Skills live in ~/.claude/skills/ (global) or .claude/skills/ (per-project). Restart Claude Code after installing.

Commands — how to trigger Ablation Planner

  • /ablation-planner Codex-designed ablation study plans for ML papers, vetted for feasibility by Claude Code.

It also activates on plain-language prompts like these:

  • Plan ablation studies that isolate each novel component in my paper
  • Sweep the key hyperparameters and check compute feasibility for ablations
  • Design reviewer-proof ablations for my ML paper submission

Frequently asked questions

Is the Ablation Planner skill free?
Yes. The skill itself is free from wanshuiyin/Auto-claude-code-research-in-sleep. SkillProof publishes the install command and an independent test verdict at no cost.
Does Ablation Planner work with Claude Code?
We tested it with Claude Code 2.x (agent harness) on Jul 10, 2026. Verdict: Works with setup. Its headline mechanic hands design work to a Codex tool that wasn't available in this environment, so that step had to be simulated by hand - real friction for anyone without Codex configured.
What is the Ablation Planner SkillProof Score?
8.0/10 — installs cleanly 4/5, triggers reliably 5/5, output vs. baseline 7/10, docs & honesty 4/5.
How do I install Ablation Planner?
Copy the install command from this page, run it in your terminal, and restart Claude Code. Skills live in ~/.claude/skills/ (global) or .claude/skills/ inside a project.
Can I use Ablation Planner with Cursor, Copilot, Gemini CLI, Codex or other AI tools?
The SKILL.md format is native to Claude (Claude Code, Desktop, claude.ai). The instructions inside adapt to other assistants: Cursor rules, GitHub Copilot instructions, Windsurf rules, Custom GPTs, AGENTS.md for OpenAI Codex, and GEMINI.md for Google Gemini CLI — our conversion guides cover each, and the free converter on the tools page does the wrapping for you.