Aaai Artifact Evaluation
Package AAAI code/data artifacts for reviewers without breaking double-blind rules
Test report
- Verdict
- Works with setup
- Score
- Tested
- Jul 21, 2026
- Environment
- Claude Code 2.x (agent harness)
- Upstream re-checked
- Aug 10, 2026 · 9a2011c
Fetched SKILL.md raw from the repo tree; frontmatter parses with name+description and the body is self-contained (no scripts or file references to break). Trigger test: 3 packaging/appendix/post-acceptance phrasings loaded it, 2 adjacent AAAI tasks (rebuttal drafting, related-work) correctly did not — 5/5. For output I gave both a baseline and skill-followed answer to "package my AAAI-26 SAT-solver 25% speedup artifact": the baseline's first advice was "put code in a public GitHub repo and link it in the paper," which is exactly the mutable deanonymizing pointer the skill flags as a Phase-1 summary-reject risk; the skill version instead forbids that URL, requires stripping .git history/home paths/API keys, treats the supplement as immutable, and emits the structured status block. Both artifacts written to scratchpad.
Scored on four weighted criteria — install, triggering, output vs. baseline, docs. How scoring works
- Installs cleanly 5/5
- Triggers reliably 5/5
- Output vs. baseline 5/10
- Docs & honesty 5/5
What Aaai Artifact Evaluation does
A guidance skill for assembling AAAI reproducibility artifacts: technical appendices, code/data ZIPs, and post-acceptance releases. Triggers when packaging AAAI supplementary material, stripping anonymity leaks (git history, paths, API keys), or planning a review-time reproduction path. Outputs a structured artifact-status report (status, submitted files, reproduction path, anonymity risks, missing items).
How to install Aaai Artifact Evaluation
git clone --depth 1 https://github.com/brycewang-stanford/Awesome-Journal-Skills.git /tmp/aaai-artifact-evaluation-src
mkdir -p ~/.claude/skills
cp -R /tmp/aaai-artifact-evaluation-src/AAAI-Skills/skills/aaai-artifact-evaluation ~/.claude/skills/aaai-artifact-evaluation
# Pure advisory skill: single SKILL.md, no scripts or external deps.
# Part of a 12-skill AAAI plugin; the whole pack lives under AAAI-Skills/skills/.
# Plugin-marketplace alt: AAAI-Skills/.claude-plugin/marketplace.json exists in the repo.
Skills live in ~/.claude/skills/ (global) or .claude/skills/
(per-project). Restart Claude Code after installing.
Commands — how to trigger Aaai Artifact Evaluation
-
/aaai-artifact-evaluationPackage AAAI code/data artifacts for reviewers without breaking double-blind rules
It also activates on plain-language prompts like these:
-
Package the code appendix for AAAI submission -
Prepare a reproducibility artifact release for AAAI -
Check this supplement doesn't violate double-blind rules
Frequently asked questions
- Is the Aaai Artifact Evaluation skill free?
- Yes. The skill itself is free from brycewang-stanford/Awesome-Journal-Skills. SkillProof publishes the install command and an independent test verdict at no cost.
- Does Aaai Artifact Evaluation work with Claude Code?
- We tested it with Claude Code 2.x (agent harness) on Jul 21, 2026. Verdict: Works with setup. Fetched SKILL.md raw from the repo tree; frontmatter parses with name+description and the body is self-contained (no scripts or file references to break). Trigger test: 3 packaging/appendix/post-acceptance phrasings loaded it, 2 adjacent AAAI tasks (rebuttal drafting, related-work) correctly did not — 5/5. For output I gave both a baseline and skill-followed answer to "package my AAAI-26 SAT-solver 25% speedup artifact": the baseline's first advice was "put code in a public GitHub repo and link it in the paper," which is exactly the mutable deanonymizing pointer the skill flags as a Phase-1 summary-reject risk; the skill version instead forbids that URL, requires stripping .git history/home paths/API keys, treats the supplement as immutable, and emits the structured status block. Both artifacts written to scratchpad.
- What is the Aaai Artifact Evaluation SkillProof Score?
- 8.0/10 — installs cleanly 5/5, triggers reliably 5/5, output vs. baseline 5/10, docs & honesty 5/5.
- How do I install Aaai Artifact Evaluation?
- Copy the install command from this page, run it in your terminal, and restart Claude Code. Skills live in ~/.claude/skills/ (global) or .claude/skills/ inside a project.
- Can I use Aaai Artifact Evaluation with Cursor, Copilot, Gemini CLI, Codex or other AI tools?
- The SKILL.md format is native to Claude (Claude Code, Desktop, claude.ai). The instructions inside adapt to other assistants: Cursor rules, GitHub Copilot instructions, Windsurf rules, Custom GPTs, AGENTS.md for OpenAI Codex, and GEMINI.md for Google Gemini CLI — our conversion guides cover each, and the free converter on the tools page does the wrapping for you.