Scrape URL

Component Details

v1.0.0

Basic Information

appmixer.firecrawl.core.ScrapeUrl

Scrape URL

1.0.0

Public

Scrape a single URL and return its content as LLM-ready markdown, optionally together with HTML, links, a summary or a screenshot.

Input Ports

in

FieldTypeDescription
URL text The URL of the page to scrape, e.g. https://example.com/blog. Markdown content is always returned.
Include HTML toggle Also return the processed HTML of the page.
Include Raw HTML toggle Also return the raw, unprocessed HTML of the page.
Include Links toggle Also return the list of links found on the page.
Include Summary toggle Also return an LLM generated summary of the page content.
Include Screenshot toggle Also return a URL of a screenshot of the page.
Only Main Content toggle Return only the main content of the page, excluding headers, navigation and footers.
Wait For (ms) number Delay in milliseconds before fetching the content, allowing the page to load. Leave empty for no extra delay.
Timeout (ms) number Request timeout in milliseconds (1000-300000). Defaults to 60000.
Emulate Mobile Device toggle Scrape the page as a mobile device.

Output Ports

out

FieldTypeDescription
Markdown string -
HTML string -
Raw HTML string -
Links array -
Summary string -
Screenshot URL string -
Metadata object -

Full Metadata