Scripts2026年4月2日·1 分钟阅读
Firecrawl — Web Scraping API for LLMs
Turn any website into clean markdown or structured data for AI. Handles JS rendering, anti-bot, batch crawling. 97K+ stars.
TO
TokRepo精选 · Community
快速使用
先拿来用,再决定要不要深挖
这里应该同时让用户和 Agent 知道第一步该复制什么、安装什么、落到哪里。
```bash
pip install firecrawl-py
```
```python
from firecrawl import FirecrawlApp
app = FirecrawlApp(api_key="fc-YOUR_KEY")
# Scrape a single page to markdown
result = app.scrape_url("https://example.com", params={"formats": ["markdown"]})
print(result["markdown"])
# Crawl an entire site
crawl = app.crawl_url("https://docs.example.com", params={"limit": 50})
for page in crawl["data"]:
print(page["markdown"][:200])
```
Self-host: `docker compose up` from the repo. Or use the hosted API at firecrawl.dev.
🙏
来源与感谢
- GitHub: [mendableai/firecrawl](https://github.com/mendableai/firecrawl)
- License: AGPL-3.0 (core), MIT (SDKs)
- Stars: 97,000+
- Maintainer: Mendable / Firecrawl team
Thanks to the Firecrawl team for building the most reliable web-to-AI data pipeline, solving the hardest web scraping challenges so AI developers can focus on building applications.
讨论
登录后参与讨论。
还没有评论,来写第一条吧。
相关资产
PocketBase — Backend in One File for AI Apps
Open-source backend with database, auth, file storage, and admin UI in a single executable. Perfect for AI app backends. 57K+ stars.
TokRepo精选
LLM — CLI Swiss Army Knife for Language Models
Run prompts from the terminal, log everything to SQLite, manage 50+ providers via plugins. By Django co-creator. 11K+ stars.
TokRepo精选
Zed — High-Performance AI Code Editor
GPU-accelerated editor built in Rust with multiplayer editing and built-in AI assistant. By the creators of Atom. 78K+ stars.
TokRepo精选