Ablation Planner
Codex-designed ablation study plans for ML papers, vetted for feasibility by Claude Code.
Test report
- Verdict
- Works with setup
- Score
- Tested
- Jul 10, 2026
- Environment
- Claude Code 2.x (agent harness)
- Upstream re-checked
- Aug 10, 2026 · bf421af
Its headline mechanic hands design work to a Codex tool that wasn't available in this environment, so that step had to be simulated by hand - real friction for anyone without Codex configured.
Scored on four weighted criteria — install, triggering, output vs. baseline, docs. How scoring works
- Installs cleanly 4/5
- Triggers reliably 5/5
- Output vs. baseline 7/10
- Docs & honesty 4/5
What Ablation Planner does
Ablation-planner has Codex act as a critical peer reviewer to design ablation studies that isolate each novel component, sweep key hyperparameters, and pre-answer likely reviewer questions, while Claude Code checks compute feasibility and implements the runs. It's meant to trigger after main results pass the companion result-to-claim skill (claim_supported=yes/partial), or whenever a user explicitly asks to plan ablations for a paper submission. It hard-depends on the mcp__codex__codex MCP tool for the core design step; without that tool configured, the documented dual-agent workflow cannot run as written.
How to install Ablation Planner
git clone https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep
cd Auto-claude-code-research-in-sleep
mkdir -p ~/.claude/skills
cp -r skills/ablation-planner ~/.claude/skills/ablation-planner
Skills live in ~/.claude/skills/ (global) or .claude/skills/
(per-project). Restart Claude Code after installing.
Commands — how to trigger Ablation Planner
-
/ablation-plannerCodex-designed ablation study plans for ML papers, vetted for feasibility by Claude Code.
It also activates on plain-language prompts like these:
-
Plan ablation studies that isolate each novel component in my paper -
Sweep the key hyperparameters and check compute feasibility for ablations -
Design reviewer-proof ablations for my ML paper submission
Frequently asked questions
- Is the Ablation Planner skill free?
- Yes. The skill itself is free from wanshuiyin/Auto-claude-code-research-in-sleep. SkillProof publishes the install command and an independent test verdict at no cost.
- Does Ablation Planner work with Claude Code?
- We tested it with Claude Code 2.x (agent harness) on Jul 10, 2026. Verdict: Works with setup. Its headline mechanic hands design work to a Codex tool that wasn't available in this environment, so that step had to be simulated by hand - real friction for anyone without Codex configured.
- What is the Ablation Planner SkillProof Score?
- 8.0/10 — installs cleanly 4/5, triggers reliably 5/5, output vs. baseline 7/10, docs & honesty 4/5.
- How do I install Ablation Planner?
- Copy the install command from this page, run it in your terminal, and restart Claude Code. Skills live in ~/.claude/skills/ (global) or .claude/skills/ inside a project.
- Can I use Ablation Planner with Cursor, Copilot, Gemini CLI, Codex or other AI tools?
- The SKILL.md format is native to Claude (Claude Code, Desktop, claude.ai). The instructions inside adapt to other assistants: Cursor rules, GitHub Copilot instructions, Windsurf rules, Custom GPTs, AGENTS.md for OpenAI Codex, and GEMINI.md for Google Gemini CLI — our conversion guides cover each, and the free converter on the tools page does the wrapping for you.