Arize Dataset

CLI-driven Arize dataset CRUD, versioning, and export for LLM eval sets.

Tested · Works

Test report

Verdict
Tested · Works
Score
9.6/10
Tested
Jul 14, 2026
Environment
Claude Code 2.x (agent harness)
Upstream re-checked
Jul 18, 2026 · 4046570

Produced exact `ax datasets create --file -` / `ax datasets append --json` syntax straight from the docs (right subcommand plurality, positional NAME_OR_ID, --space requirement) where a cold guess used plausible-sounding but wrong flags — a real, checkable syntax win even without a live Arize account to execute against.

Scored on four weighted criteria — install, triggering, output vs. baseline, docs. How scoring works

  • Installs cleanly 5/5
  • Triggers reliably 5/5
  • Output vs. baseline 9/10
  • Docs & honesty 5/5

What Arize Dataset does

Wraps the `ax` CLI to create, list, export, and append examples to Arize datasets used for LLM evaluation, with built-in safeguards for schema-mismatch typos and truncated (500-row) exports. Triggers on dataset CRUD language — create dataset, export dataset, append examples, golden dataset, test set — and explicitly defers to sibling arize-trace/arize-experiment skills for tracing or eval-running.

How to install Arize Dataset

git clone https://github.com/github/awesome-copilot
cd awesome-copilot
mkdir -p ~/.claude/skills
cp -r skills/arize-dataset ~/.claude/skills/arize-dataset

Skills live in ~/.claude/skills/ (global) or .claude/skills/ (per-project). Restart Claude Code after installing.

Commands — how to trigger Arize Dataset

  • /arize-dataset CLI-driven Arize dataset CRUD, versioning, and export for LLM eval sets.

It also activates on plain-language prompts like these:

  • Create a new Arize dataset from these eval examples I collected
  • Export our golden dataset from Arize so I can review it locally
  • Append these new test cases to the existing evaluation dataset

Frequently asked questions

Is the Arize Dataset skill free?
Yes. The skill itself is free from github/awesome-copilot. SkillProof publishes the install command and an independent test verdict at no cost.
Does Arize Dataset work with Claude Code?
We tested it with Claude Code 2.x (agent harness) on Jul 14, 2026. Verdict: Tested · Works. Produced exact `ax datasets create --file -` / `ax datasets append --json` syntax straight from the docs (right subcommand plurality, positional NAME_OR_ID, --space requirement) where a cold guess used plausible-sounding but wrong flags — a real, checkable syntax win even without a live Arize account to execute against.
What is the Arize Dataset SkillProof Score?
9.6/10 — installs cleanly 5/5, triggers reliably 5/5, output vs. baseline 9/10, docs & honesty 5/5.
How do I install Arize Dataset?
Copy the install command from this page, run it in your terminal, and restart Claude Code. Skills live in ~/.claude/skills/ (global) or .claude/skills/ inside a project.
Can I use Arize Dataset with Cursor, Copilot, Gemini CLI, Codex or other AI tools?
The SKILL.md format is native to Claude (Claude Code, Desktop, claude.ai). The instructions inside adapt to other assistants: Cursor rules, GitHub Copilot instructions, Windsurf rules, Custom GPTs, AGENTS.md for OpenAI Codex, and GEMINI.md for Google Gemini CLI — our conversion guides cover each, and the free converter on the tools page does the wrapping for you.