Firecrawl Web Scraping Server
搜索与获取by Krieg2065
Enable advanced web scraping, crawling, and content extraction with support for JavaScript rendering, batch processing, and smart filtering. Perform deep research and structured data extraction using LLM-powered tools. Monitor credit usage and handle rate limits automatically for efficient and reliable web data integration.
Tools (10)
firecrawl_scrapeScrape a single webpage with advanced options for content extraction. Supports various formats including markdown, HTML, and screenshots. Can execute custom actions like clicking or scrolling before scraping.
firecrawl_mapDiscover URLs from a starting point. Can use both sitemap.xml and HTML link discovery.
firecrawl_crawlStart an asynchronous crawl of multiple pages from a starting URL. Supports depth control, path filtering, and webhook notifications.
firecrawl_batch_scrapeScrape multiple URLs in batch mode. Returns a job ID that can be used to check status.
firecrawl_check_batch_statusCheck the status of a batch scraping job.
firecrawl_check_crawl_statusCheck the status of a crawl job.
firecrawl_searchSearch and retrieve content from web pages with optional scraping. Returns SERP results by default (url, title, description) or full page content when scrapeOptions are provided.
firecrawl_extractExtract structured information from web pages using LLM. Supports both cloud AI and self-hosted LLM extraction.
firecrawl_deep_researchConduct deep research on a query using web crawling, search, and AI analysis.
firecrawl_generate_llmstxtGenerate standardized LLMs.txt file for a given URL, which provides context about how LLMs should interact with the website.