Turn any website into LLM-ready markdown. API-first web scraping with JavaScript rendering, auto-pagination, structured extraction, and batch crawling.
This block should tell both the user and the agent what to copy, install, and apply first.
pip install firecrawl-pyfrom firecrawl import FirecrawlApp
app = FirecrawlApp(api_key="fc-...")
result = app.scrape_url("https://example.com", params={"formats": ["markdown"]})
print(result["markdown"])Firecrawl is an API that converts any webpage into clean markdown optimized for LLMs. Handles JavaScript rendering, anti-bot measures, pagination, and sitemaps automatically.
Best for: RAG data ingestion, web research, content monitoring, competitive analysis Works with: LangChain, LlamaIndex, any LLM pipeline
git clone https://github.com/mendableai/firecrawl.git
docker compose upCreated by Mendable. Licensed under AGPL-3.0. mendableai/firecrawl — 25K+ GitHub stars
Rust-powered Python linter and formatter. 10-100x faster than Flake8 + Black combined. 800+ lint rules, auto-fix, import sorting, and format-on-save.
Rust-powered Python package and project manager. 10-100x faster than pip. Drop-in replacement with lockfiles, virtual environments, and Python version management.
IBM document parsing library. Converts PDFs, DOCX, PPTX, images, and HTML into structured markdown or JSON. Built for RAG pipelines and LLM ingestion.