Scrape a single webpage with advanced options for content extraction. Supports various formats including markdown, HTML, and screenshots. Can execute custom actions like clicking or scrolling before scraping.
Discover URLs from a starting point. Can use both sitemap.xml and HTML link discovery.
Start an asynchronous crawl of multiple pages from a starting URL. Supports depth control, path filtering, and webhook notifications.
Scrape multiple URLs in batch mode. Returns a job ID that can be used to check status.
Check the status of a batch scraping job.
Check the status of a crawl job.
Search and retrieve content from web pages with optional scraping. Returns SERP results by default (url, title, description) or full page content when scrapeOptions are provided.
Extract structured information from web pages using LLM. Supports both cloud AI and self-hosted LLM extraction.
Conduct deep research on a query using web crawling, search, and AI analysis.
Generate standardized LLMs.txt file for a given URL, which provides context about how LLMs should interact with the website.
Your Firecrawl API key. Required for cloud API usage.
Custom API endpoint for self-hosted instances. If provided, API key becomes optional.
