Langsmith Fetch

Debug LangChain/LangGraph agents by fetching LangSmith traces via the langsmith-fetch CLI

Works with setup

Test report

Verdict
Works with setup
Score
7.6/10
Tested
Jul 21, 2026
Environment
Claude Code 2.x (agent harness)
Upstream re-checked
Aug 10, 2026 · fb36536

Located SKILL.md at SkillBank/Common/AwesomeClaudeSkills/langsmith-fetch/SKILL.md; frontmatter parses with name+description. The body bundles no scripts — it only shells out to the external langsmith-fetch CLI, which I confirmed is a real PyPI package (v0.3.1) whose documented commands (traces/trace/threads/thread, --limit, --last-n-minutes, --format pretty|json|raw, --include-metadata) match the skill. Both referenced repos returned HTTP 200. No security smells (no curl|sh, base64, or exfiltration). Could NOT run the output stage: langsmith-fetch needs a valid LANGSMITH_API_KEY and a project holding real agent traces, which I cannot provision, so no baseline-vs-skill artifact was produced. Docs lose a point for minor drift (skill shows --after and a config show/set subcommand; the real CLI uses --since) and fabricated example outputs.

Scored on four weighted criteria — install, triggering, output vs. baseline, docs. How scoring works

  • Installs cleanly 5/5
  • Triggers reliably 5/5
  • Output vs. baseline 5/10
  • Docs & honesty 4/5

What Langsmith Fetch does

Wraps the external langsmith-fetch CLI to pull recent execution traces from a LangSmith project, then analyzes errors, tool calls, token usage, and memory operations. Triggers when the user asks to debug an agent, show recent traces, check for errors, or review agent performance. Requires the pip package langsmith-fetch plus a LANGSMITH_API_KEY and a project that already has traces.

How to install Langsmith Fetch

git clone --depth 1 https://github.com/ECNU-ICALK/AutoSkill.git /tmp/langsmith-fetch-src
mkdir -p ~/.claude/skills
cp -R /tmp/langsmith-fetch-src/SkillBank/Common/AwesomeClaudeSkills/langsmith-fetch ~/.claude/skills/langsmith-fetch
# Required external dependency (the skill only calls this CLI; nothing is bundled):
#   pip install langsmith-fetch        # PyPI package, currently v0.3.1
# Required environment (skill produces nothing without these):
#   export LANGSMITH_API_KEY=lsv2_...
#   export LANGSMITH_PROJECT=your-project-name
# The target project must already contain traces from a running LangChain/LangGraph agent.
# Note: SKILL.md references some flags that differ from the real CLI (e.g. --after; real CLI uses --since).

Skills live in ~/.claude/skills/ (global) or .claude/skills/ (per-project). Restart Claude Code after installing.

Commands — how to trigger Langsmith Fetch

  • /langsmith-fetch Debug LangChain/LangGraph agents by fetching LangSmith traces via the langsmith-fetch CLI

It also activates on plain-language prompts like these:

  • Fetch the latest LangSmith trace for this agent
  • Why did my LangGraph agent call the wrong tool
  • Analyze recent agent traces for memory errors

Frequently asked questions

Is the Langsmith Fetch skill free?
Yes. The skill itself is free from ECNU-ICALK/AutoSkill. SkillProof publishes the install command and an independent test verdict at no cost.
Does Langsmith Fetch work with Claude Code?
We tested it with Claude Code 2.x (agent harness) on Jul 21, 2026. Verdict: Works with setup. Located SKILL.md at SkillBank/Common/AwesomeClaudeSkills/langsmith-fetch/SKILL.md; frontmatter parses with name+description. The body bundles no scripts — it only shells out to the external langsmith-fetch CLI, which I confirmed is a real PyPI package (v0.3.1) whose documented commands (traces/trace/threads/thread, --limit, --last-n-minutes, --format pretty|json|raw, --include-metadata) match the skill. Both referenced repos returned HTTP 200. No security smells (no curl|sh, base64, or exfiltration). Could NOT run the output stage: langsmith-fetch needs a valid LANGSMITH_API_KEY and a project holding real agent traces, which I cannot provision, so no baseline-vs-skill artifact was produced. Docs lose a point for minor drift (skill shows --after and a config show/set subcommand; the real CLI uses --since) and fabricated example outputs.
What is the Langsmith Fetch SkillProof Score?
7.6/10 — installs cleanly 5/5, triggers reliably 5/5, output vs. baseline 5/10, docs & honesty 4/5.
How do I install Langsmith Fetch?
Copy the install command from this page, run it in your terminal, and restart Claude Code. Skills live in ~/.claude/skills/ (global) or .claude/skills/ inside a project.
Can I use Langsmith Fetch with Cursor, Copilot, Gemini CLI, Codex or other AI tools?
The SKILL.md format is native to Claude (Claude Code, Desktop, claude.ai). The instructions inside adapt to other assistants: Cursor rules, GitHub Copilot instructions, Windsurf rules, Custom GPTs, AGENTS.md for OpenAI Codex, and GEMINI.md for Google Gemini CLI — our conversion guides cover each, and the free converter on the tools page does the wrapping for you.