Arize Annotation

Exact `ax` CLI syntax for Arize annotation configs, human-review queues, and bulk span labeling.

Tested · Works

Test report

Verdict
Tested · Works
Score
9.6/10
Tested
Jul 13, 2026
Environment
Claude Code 2.x (agent harness)
Upstream re-checked
Aug 10, 2026 · 3f69f32

Asked it to bulk-apply correctness labels to spans: it produced the exact pandas DataFrame schema (`context.span_id` + `annotation.<name>.label`/`.score`/`.updated_by`) and correctly surfaced the 31-day annotation window limit — specifics a baseline guess at Arize's API would have missed or invented wrong.

Scored on four weighted criteria — install, triggering, output vs. baseline, docs. How scoring works

  • Installs cleanly 5/5
  • Triggers reliably 5/5
  • Output vs. baseline 9/10
  • Docs & honesty 5/5

What Arize Annotation does

Wraps Arize's `ax` CLI and Python SDK for creating categorical/continuous/freeform annotation-label schemas, building human-review queues with reviewer assignment, and bulk-applying labels to project spans via a pandas DataFrame. Triggers on mentions of annotation config, annotation queue, label schema, bulk-annotate spans, or human review — an ML-observability/data-labeling workflow, not general coding.

How to install Arize Annotation

git clone https://github.com/github/awesome-copilot
cd awesome-copilot
mkdir -p ~/.claude/skills
cp -r skills/arize-annotation ~/.claude/skills/arize-annotation

Skills live in ~/.claude/skills/ (global) or .claude/skills/ (per-project). Restart Claude Code after installing.

Commands — how to trigger Arize Annotation

  • /arize-annotation Exact `ax` CLI syntax for Arize annotation configs, human-review queues, and bulk span labeling.

It also activates on plain-language prompts like these:

  • Set up a categorical annotation schema for our Arize project spans
  • I need a human-review queue with reviewer assignment in Arize set up
  • Bulk-apply labels to these spans from a pandas dataframe using Arize

Frequently asked questions

Is the Arize Annotation skill free?
Yes. The skill itself is free from github/awesome-copilot. SkillProof publishes the install command and an independent test verdict at no cost.
Does Arize Annotation work with Claude Code?
We tested it with Claude Code 2.x (agent harness) on Jul 13, 2026. Verdict: Tested · Works. Asked it to bulk-apply correctness labels to spans: it produced the exact pandas DataFrame schema (`context.span_id` + `annotation.<name>.label`/`.score`/`.updated_by`) and correctly surfaced the 31-day annotation window limit — specifics a baseline guess at Arize's API would have missed or invented wrong.
What is the Arize Annotation SkillProof Score?
9.6/10 — installs cleanly 5/5, triggers reliably 5/5, output vs. baseline 9/10, docs & honesty 5/5.
How do I install Arize Annotation?
Copy the install command from this page, run it in your terminal, and restart Claude Code. Skills live in ~/.claude/skills/ (global) or .claude/skills/ inside a project.
Can I use Arize Annotation with Cursor, Copilot, Gemini CLI, Codex or other AI tools?
The SKILL.md format is native to Claude (Claude Code, Desktop, claude.ai). The instructions inside adapt to other assistants: Cursor rules, GitHub Copilot instructions, Windsurf rules, Custom GPTs, AGENTS.md for OpenAI Codex, and GEMINI.md for Google Gemini CLI — our conversion guides cover each, and the free converter on the tools page does the wrapping for you.