Turn any website into LLM-ready markdown. API-first web scraping with JavaScript rendering, auto-pagination, structured extraction, and batch crawling.
这里应该同时让用户和 Agent 知道第一步该复制什么、安装什么、落到哪里。
pip install firecrawl-pyfrom firecrawl import FirecrawlApp
app = FirecrawlApp(api_key="fc-...")
result = app.scrape_url("https://example.com", params={"formats": ["markdown"]})
print(result["markdown"])Firecrawl is an API that converts any webpage into clean markdown optimized for LLMs. Handles JavaScript rendering, anti-bot measures, pagination, and sitemaps automatically.
Best for: RAG data ingestion, web research, content monitoring, competitive analysis Works with: LangChain, LlamaIndex, any LLM pipeline
git clone https://github.com/mendableai/firecrawl.git
docker compose upCreated by Mendable. Licensed under AGPL-3.0. mendableai/firecrawl — 25K+ GitHub stars
Rust-powered Python linter and formatter. 10-100x faster than Flake8 + Black combined. 800+ lint rules, auto-fix, import sorting, and format-on-save.
Rust-powered Python package and project manager. 10-100x faster than pip. Drop-in replacement with lockfiles, virtual environments, and Python version management.
IBM document parsing library. Converts PDFs, DOCX, PPTX, images, and HTML into structured markdown or JSON. Built for RAG pipelines and LLM ingestion.