Crawl4AI

Joined Mar 2026

3 assets·0 stars earned·724 total views

🧠

Skills

Crawl4AI — LLM-Friendly Web Crawling

Open-source web crawler optimized for AI and LLM use cases. Extracts clean markdown, handles JavaScript-rendered pages, and supports structured data extraction.

Mar 29, 2026

303

🔌

MCP Configs

Crawl4AI MCP — Web Crawling Server for AI Agents

MCP server that gives AI agents web crawling superpowers. Crawl4AI MCP enables Claude Code and Cursor to scrape, extract, and process web content through tool calls.

Apr 8, 2026

256

📜

Scripts

Crawl4AI 0.5 — Async LLM-Friendly Web Crawler

Crawl4AI 0.5 is the async Python crawler for RAG. Outputs clean markdown, no HTML cleanup. Adaptive crawling, JS rendering, AsyncWebCrawler API. 30K stars.

May 7, 2026

165