Arize AI Provider Integration
CRUDs Arize's stored LLM-provider credentials (OpenAI, Anthropic, Bedrock, Vertex, Gemini, NIM) via the ax CLI.
Test report
- Verdict
- Tested · Works
- Score
- Tested
- Jul 13, 2026
- Environment
- Claude Code 2.x (agent harness)
- Upstream re-checked
- Aug 10, 2026 · 806be8e
Gave it a Bedrock-integration task with a real IAM role ARN: the skill produced `ax ai-integrations create --provider awsBedrock --provider-metadata '{"role_arn":...}'` while an unguided guess used the wrong subcommand, wrong provider casing, and illegally passed --space to create (the docs explicitly call out that create is account-scoped and doesn't take --space).
Scored on four weighted criteria — install, triggering, output vs. baseline, docs. How scoring works
- Installs cleanly 5/5
- Triggers reliably 5/5
- Output vs. baseline 9/10
- Docs & honesty 5/5
What Arize AI Provider Integration does
Wraps the `ax ai-integrations` subcommands to create, list, get, update and delete the LLM credentials Arize evaluators use to call a judge model. Covers per-provider flag differences (API-key providers vs IAM-role Bedrock vs GCP-project Vertex) and enforces safe credential handling (never inline raw keys, always reference $ARIZE_API_KEY). Triggers on 'AI integration', 'LLM provider credentials', 'connect an LLM provider to Arize', and similar; requires the ax CLI and an Arize account/API key to actually run.
How to install Arize AI Provider Integration
git clone https://github.com/github/awesome-copilot
cd awesome-copilot
mkdir -p ~/.claude/skills
cp -r skills/arize-ai-provider-integration ~/.claude/skills/arize-ai-provider-integration
Skills live in ~/.claude/skills/ (global) or .claude/skills/
(per-project). Restart Claude Code after installing.
Commands — how to trigger Arize AI Provider Integration
-
/arize-ai-provider-integrationCRUDs Arize's stored LLM-provider credentials (OpenAI, Anthropic, Bedrock, Vertex, Gemini, NIM) via the ax CLI.
It also activates on plain-language prompts like these:
-
Create an Arize AI integration using my Anthropic API key -
List all the LLM provider credentials connected to our Arize account -
Update the API key stored on our OpenAI integration in Arize
Frequently asked questions
- Is the Arize AI Provider Integration skill free?
- Yes. The skill itself is free from github/awesome-copilot. SkillProof publishes the install command and an independent test verdict at no cost.
- Does Arize AI Provider Integration work with Claude Code?
- We tested it with Claude Code 2.x (agent harness) on Jul 13, 2026. Verdict: Tested · Works. Gave it a Bedrock-integration task with a real IAM role ARN: the skill produced `ax ai-integrations create --provider awsBedrock --provider-metadata '{"role_arn":...}'` while an unguided guess used the wrong subcommand, wrong provider casing, and illegally passed --space to create (the docs explicitly call out that create is account-scoped and doesn't take --space).
- What is the Arize AI Provider Integration SkillProof Score?
- 9.6/10 — installs cleanly 5/5, triggers reliably 5/5, output vs. baseline 9/10, docs & honesty 5/5.
- How do I install Arize AI Provider Integration?
- Copy the install command from this page, run it in your terminal, and restart Claude Code. Skills live in ~/.claude/skills/ (global) or .claude/skills/ inside a project.
- Can I use Arize AI Provider Integration with Cursor, Copilot, Gemini CLI, Codex or other AI tools?
- The SKILL.md format is native to Claude (Claude Code, Desktop, claude.ai). The instructions inside adapt to other assistants: Cursor rules, GitHub Copilot instructions, Windsurf rules, Custom GPTs, AGENTS.md for OpenAI Codex, and GEMINI.md for Google Gemini CLI — our conversion guides cover each, and the free converter on the tools page does the wrapping for you.