Arize Annotation
Exact `ax` CLI syntax for Arize annotation configs, human-review queues, and bulk span labeling.
Test report
- Verdict
- Tested · Works
- Score
- Tested
- Jul 13, 2026
- Environment
- Claude Code 2.x (agent harness)
- Upstream re-checked
- Aug 10, 2026 · 3f69f32
Asked it to bulk-apply correctness labels to spans: it produced the exact pandas DataFrame schema (`context.span_id` + `annotation.<name>.label`/`.score`/`.updated_by`) and correctly surfaced the 31-day annotation window limit — specifics a baseline guess at Arize's API would have missed or invented wrong.
Scored on four weighted criteria — install, triggering, output vs. baseline, docs. How scoring works
- Installs cleanly 5/5
- Triggers reliably 5/5
- Output vs. baseline 9/10
- Docs & honesty 5/5
What Arize Annotation does
Wraps Arize's `ax` CLI and Python SDK for creating categorical/continuous/freeform annotation-label schemas, building human-review queues with reviewer assignment, and bulk-applying labels to project spans via a pandas DataFrame. Triggers on mentions of annotation config, annotation queue, label schema, bulk-annotate spans, or human review — an ML-observability/data-labeling workflow, not general coding.
How to install Arize Annotation
git clone https://github.com/github/awesome-copilot
cd awesome-copilot
mkdir -p ~/.claude/skills
cp -r skills/arize-annotation ~/.claude/skills/arize-annotation
Skills live in ~/.claude/skills/ (global) or .claude/skills/
(per-project). Restart Claude Code after installing.
Commands — how to trigger Arize Annotation
-
/arize-annotationExact `ax` CLI syntax for Arize annotation configs, human-review queues, and bulk span labeling.
It also activates on plain-language prompts like these:
-
Set up a categorical annotation schema for our Arize project spans -
I need a human-review queue with reviewer assignment in Arize set up -
Bulk-apply labels to these spans from a pandas dataframe using Arize
Frequently asked questions
- Is the Arize Annotation skill free?
- Yes. The skill itself is free from github/awesome-copilot. SkillProof publishes the install command and an independent test verdict at no cost.
- Does Arize Annotation work with Claude Code?
- We tested it with Claude Code 2.x (agent harness) on Jul 13, 2026. Verdict: Tested · Works. Asked it to bulk-apply correctness labels to spans: it produced the exact pandas DataFrame schema (`context.span_id` + `annotation.<name>.label`/`.score`/`.updated_by`) and correctly surfaced the 31-day annotation window limit — specifics a baseline guess at Arize's API would have missed or invented wrong.
- What is the Arize Annotation SkillProof Score?
- 9.6/10 — installs cleanly 5/5, triggers reliably 5/5, output vs. baseline 9/10, docs & honesty 5/5.
- How do I install Arize Annotation?
- Copy the install command from this page, run it in your terminal, and restart Claude Code. Skills live in ~/.claude/skills/ (global) or .claude/skills/ inside a project.
- Can I use Arize Annotation with Cursor, Copilot, Gemini CLI, Codex or other AI tools?
- The SKILL.md format is native to Claude (Claude Code, Desktop, claude.ai). The instructions inside adapt to other assistants: Cursor rules, GitHub Copilot instructions, Windsurf rules, Custom GPTs, AGENTS.md for OpenAI Codex, and GEMINI.md for Google Gemini CLI — our conversion guides cover each, and the free converter on the tools page does the wrapping for you.