Firecrawl
Firecrawl
The tool_firecrawl node exposes Firecrawl web-scraping operations to an AI
agent. It gives an agent the ability to scrape live web pages and map website
structures using the Firecrawl API — useful when an agent needs to read current
web content or discover URLs across a site.
This is a pure tool node: it has no pipeline lanes and is invoked by an agent node, not wired into data lanes.
When to use Firecrawl
- Live web reading — let an agent fetch and read a page's content on demand.
- Site discovery — map a site's structure to find URLs before scraping specific pages.
- Research agents — combine scraping with other tools in a reasoning loop.
Configuration
| Field | Type | Default | Description |
|---|---|---|---|
apikey | string | "" | Firecrawl API key. Required — startup fails if empty. |
The node ships a single default profile and uses the firecrawl-py SDK
(FirecrawlApp). The client is created once when the pipeline starts. All
Firecrawl calls are wrapped with automatic retry handling: rate-limit responses
(HTTP 429) retry indefinitely with a 5-second sleep between attempts, and server
errors (HTTP 5xx) retry up to 5 times with the same delay before the error is
raised.
Agent tools
Tools are registered under the firecrawl prefix.
| Tool | What it does |
|---|---|
scrape_url | Scrape a single web page and return its content. Returns { success, content, metadata }; falls back to markdown content if the requested format is unavailable. |
map_url | Map a website's structure from a root url and return all discovered URLs as { success, links }. |
Authentication
Set apikey to a Firecrawl API key (created at
firecrawl.dev). The key is passed directly to
FirecrawlApp; no other credentials are needed.