Agent Research Aggregator
Scans AI agent cache logs and formats them into PaperOrchestra idea.md + experimental_log.md
Test report
- Verdict
- Tested · Works
- Score
- Tested
- Jul 21, 2026
- Environment
- Claude Code 2.x (agent harness)
- Upstream re-checked
- Aug 10, 2026 · 06c510e
Cloned the repo and ran the pipeline in a temp HOME against a fabricated RL-experiment project (.claude/memory + results_doorkey.json + NOTES.md). discover_logs.py exited 2 with no --project and 0 after --project (matching SKILL.md); the general-file scan has no ** recursion, so I had to point --search-roots directly at the project dir before it found the 3 files. I authored synthesis.json to the documented Phase-3 schema and format_po_inputs.py deterministically produced idea.md (Sparse schema), experimental_log.md (numbered sections + aligned GFM results table + iteration history), and aggregation_report.md with data-quality warnings and a missing-inputs checklist. Compared against an ad-hoc baseline idea/log I wrote from the same logs: the skill output is schema-conformant and downstream-consumable where the baseline is loose prose with results as bullets. grep across all three scripts found no network/exec/base64/exfil patterns; scripts are read-only on cache dirs and skip .env/credentials/keys. The arXiv id 2604.05018 cited throughout is unverifiable.
Scored on four weighted criteria — install, triggering, output vs. baseline, docs. How scoring works
- Installs cleanly 5/5
- Triggers reliably 5/5
- Output vs. baseline 6/10
- Docs & honesty 4/5
What Agent Research Aggregator does
A pre-processing skill that discovers experimentation logs in AI coding-agent cache directories (.claude, .cursor, .antigravity, .openclaw) or any given folder, then extracts and synthesizes them into the structured idea.md and experimental_log.md input pair the PaperOrchestra paper-writing pipeline expects. Triggers when the user asks to aggregate agent logs for paper writing, prepare PaperOrchestra inputs from a cache, or turn scattered experiment histories into a paper draft. Runs as a cheap pre-pass before the paper-orchestra skill.
How to install Agent Research Aggregator
git clone --depth 1 https://github.com/Ar9av/PaperOrchestra.git /tmp/agent-research-aggregator-src
mkdir -p ~/.claude/skills
cp -R /tmp/agent-research-aggregator-src/skills/agent-research-aggregator ~/.claude/skills/agent-research-aggregator
# Deps: python3 only (stdlib argparse/json/pathlib — no pip install needed for the deterministic scripts).
# Phases 2 & 3 (extraction + synthesis) are LLM calls the host agent performs; no API key wired into the scripts.
# The skill's scripts reference paths as skills/agent-research-aggregator/scripts/*.py — run them from a repo checkout
# or adjust to ~/.claude/skills/agent-research-aggregator/scripts/*.py
# Downstream paper-orchestra also needs user-supplied template.tex + conference_guidelines.md.
Skills live in ~/.claude/skills/ (global) or .claude/skills/
(per-project). Restart Claude Code after installing.
Commands — how to trigger Agent Research Aggregator
-
/agent-research-aggregatorScans AI agent cache logs and formats them into PaperOrchestra idea.md + experimental_log.md
It also activates on plain-language prompts like these:
-
Aggregate my Claude agent logs for paper writing -
Extract experiments from my coding agent history -
Prepare PaperOrchestra inputs from my .cursor cache
Frequently asked questions
- Is the Agent Research Aggregator skill free?
- Yes. The skill itself is free from Ar9av/PaperOrchestra. SkillProof publishes the install command and an independent test verdict at no cost.
- Does Agent Research Aggregator work with Claude Code?
- We tested it with Claude Code 2.x (agent harness) on Jul 21, 2026. Verdict: Tested · Works. Cloned the repo and ran the pipeline in a temp HOME against a fabricated RL-experiment project (.claude/memory + results_doorkey.json + NOTES.md). discover_logs.py exited 2 with no --project and 0 after --project (matching SKILL.md); the general-file scan has no ** recursion, so I had to point --search-roots directly at the project dir before it found the 3 files. I authored synthesis.json to the documented Phase-3 schema and format_po_inputs.py deterministically produced idea.md (Sparse schema), experimental_log.md (numbered sections + aligned GFM results table + iteration history), and aggregation_report.md with data-quality warnings and a missing-inputs checklist. Compared against an ad-hoc baseline idea/log I wrote from the same logs: the skill output is schema-conformant and downstream-consumable where the baseline is loose prose with results as bullets. grep across all three scripts found no network/exec/base64/exfil patterns; scripts are read-only on cache dirs and skip .env/credentials/keys. The arXiv id 2604.05018 cited throughout is unverifiable.
- What is the Agent Research Aggregator SkillProof Score?
- 8.0/10 — installs cleanly 5/5, triggers reliably 5/5, output vs. baseline 6/10, docs & honesty 4/5.
- How do I install Agent Research Aggregator?
- Copy the install command from this page, run it in your terminal, and restart Claude Code. Skills live in ~/.claude/skills/ (global) or .claude/skills/ inside a project.
- Can I use Agent Research Aggregator with Cursor, Copilot, Gemini CLI, Codex or other AI tools?
- The SKILL.md format is native to Claude (Claude Code, Desktop, claude.ai). The instructions inside adapt to other assistants: Cursor rules, GitHub Copilot instructions, Windsurf rules, Custom GPTs, AGENTS.md for OpenAI Codex, and GEMINI.md for Google Gemini CLI — our conversion guides cover each, and the free converter on the tools page does the wrapping for you.