Is the Crawl4AI skill free?

Yes. The skill itself is free from brettdavies/crawl4ai-skill. SkillProof publishes the install command and an independent test verdict at no cost.

What is the Crawl4AI SkillProof Score?

10.0/10 — installs cleanly 5/5, triggers reliably 5/5, output vs. baseline 10/10, docs & honesty 5/5.

How do I install Crawl4AI?

Copy the install command from this page, run it in your terminal, and restart Claude Code. Skills live in ~/.claude/skills/ (global) or .claude/skills/ inside a project.

Can I use Crawl4AI with Cursor, Copilot, Gemini CLI, Codex or other AI tools?

The SKILL.md format is native to Claude (Claude Code, Desktop, claude.ai). The instructions inside adapt to other assistants: Cursor rules, GitHub Copilot instructions, Windsurf rules, Custom GPTs, AGENTS.md for OpenAI Codex, and GEMINI.md for Google Gemini CLI — our conversion guides cover each, and the free converter on the tools page does the wrapping for you.

Crawl4AI

Wraps the Crawl4AI browser scraper for JS-heavy sites, batch crawls, and LLM-free schema extraction.

by brettdavies · brettdavies/crawl4ai-skill

Tested · Works

Install — copy the command Download source ↗

Test report

Verdict: Tested · Works
Score: 10.0/10
Tested: Jul 14, 2026
Environment: Claude Code 2.x (agent harness)
Upstream re-checked: Jul 18, 2026 · 9ad9095

Ran the skill's exact recommended command against a live JS-rendered test page: a naive curl+CSS-selector scrape returned zero quotes, while `crwl ... -c wait_until=networkidle` returned all ten quotes with authors and tags cleanly formatted in markdown.

Scored on four weighted criteria — install, triggering, output vs. baseline, docs. How scoring works

Installs cleanly 5/5
Triggers reliably 5/5
Output vs. baseline 10/10
Docs & honesty 5/5

What Crawl4AI does

Provides CLI (crwl) and Python SDK patterns for Crawl4AI, a Playwright-backed crawler that renders JavaScript-heavy pages and SPAs that plain HTTP fetches can't reach. Covers clean markdown generation, LLM-free CSS/JSON schema extraction, concurrent multi-URL batch crawling, sitemap-driven URL discovery, and login/session handling. Triggers on crawl4ai, crwl, scraping SPAs/JS-heavy sites, and schema-based extraction; explicitly defers to lighter tools (defuddle/fetch-web) for static HTML.

How to install Crawl4AI

git clone https://github.com/brettdavies/crawl4ai-skill
cd crawl4ai-skill
mkdir -p ~/.claude/skills
cp -r . ~/.claude/skills/crawl4ai

Skills live in ~/.claude/skills/ (global) or .claude/skills/ (per-project). Restart Claude Code after installing.

Commands — how to trigger Crawl4AI

/crawl4ai Wraps the Crawl4AI browser scraper for JS-heavy sites, batch crawls, and LLM-free schema extraction.

It also activates on plain-language prompts like these:

Scrape this SPA's product listings, it's all client-rendered React.
Crawl 500 URLs from this sitemap into clean markdown for me.
Extract price and name from these product pages with a CSS schema.

Frequently asked questions

Is the Crawl4AI skill free?: Yes. The skill itself is free from brettdavies/crawl4ai-skill. SkillProof publishes the install command and an independent test verdict at no cost.
Does Crawl4AI work with Claude Code?: We tested it with Claude Code 2.x (agent harness) on Jul 14, 2026. Verdict: Tested · Works. Ran the skill's exact recommended command against a live JS-rendered test page: a naive curl+CSS-selector scrape returned zero quotes, while `crwl ... -c wait_until=networkidle` returned all ten quotes with authors and tags cleanly formatted in markdown.
What is the Crawl4AI SkillProof Score?: 10.0/10 — installs cleanly 5/5, triggers reliably 5/5, output vs. baseline 10/10, docs & honesty 5/5.
How do I install Crawl4AI?: Copy the install command from this page, run it in your terminal, and restart Claude Code. Skills live in ~/.claude/skills/ (global) or .claude/skills/ inside a project.
Can I use Crawl4AI with Cursor, Copilot, Gemini CLI, Codex or other AI tools?: The SKILL.md format is native to Claude (Claude Code, Desktop, claude.ai). The instructions inside adapt to other assistants: Cursor rules, GitHub Copilot instructions, Windsurf rules, Custom GPTs, AGENTS.md for OpenAI Codex, and GEMINI.md for Google Gemini CLI — our conversion guides cover each, and the free converter on the tools page does the wrapping for you.