Skip to main content
View source

Firecrawl

View as Markdown

A RocketRide tool node that exposes Firecrawl web-scraping operations to an AI agent.

What it does

Gives an agent the ability to scrape web pages and map website structures using the Firecrawl API. Useful for agents that need to read live web content or discover URLs across a site.

Uses the firecrawl-py SDK (FirecrawlApp). The client is created once when the pipeline starts; a non-empty apikey is required or startup fails.

All Firecrawl calls are wrapped with automatic retry handling: rate-limit responses (HTTP 429) are retried indefinitely with a 5-second sleep between attempts, and server errors (HTTP 5xx) are retried up to 5 times with the same delay before the error is raised.


Configuration

FieldTypeDescription
apikeystringDefault empty. Firecrawl API key

The node ships a single default profile. It has no lanes; it registers as a tool provider and is invoked by an agent node, not wired into data lanes.


Available tools

Tools are registered under the firecrawl prefix.

scrape_url

Scrape a single web page and return its content.

| Tool | Description | |---|---|---| | scrape_url | Scrape a single web page and return its content. | | map_url | Map a website's structure and return all discovered URLs. |

Returns { success, content, metadata }. If the requested format is unavailable in the Firecrawl response, the node falls back to markdown content; non-string content is JSON-encoded.

map_url

Map a website's structure and return all discovered URLs.

ParameterRequiredDescription
urlyesRoot URL to map

Returns { success, links } where links is an array of discovered URL strings.


Authentication

Set apikey to a Firecrawl API key (created at firecrawl.dev). The key is passed directly to FirecrawlApp, no other credentials are needed.


Upstream docs


Schema

FieldTypeDescriptionDefault
tool_firecrawl.apikeystringAPI Key
Firecrawl API key
""

Dependencies

  • firecrawl-py