Struct ScrapeRequest 

pub struct ScrapeRequest {

    pub url: String,
    pub formats: Vec<String>,
    pub headers: HashMap<String, String>,
    pub include_tags: Vec<String>,
    pub exclude_tags: Vec<String>,
    pub only_main_content: bool,
    pub timeout: u64,
    pub wait_for: u64,
    pub remove_base64_images: bool,
    pub skip_tls_verification: bool,
    pub engine: String,
    pub wait_for_selector: Option<String>,
    pub actions: Vec<BrowserAction>,
    pub screenshot: bool,
    pub screenshot_format: String,
}

Main scrape request matching Firecrawl v1 schema

Fields

url: String

Required: URL to scrape

formats: Vec<String>

Output formats (default: [“markdown”])

headers: HashMap<String, String>

Headers to send with request

include_tags: Vec<String>

CSS selectors to include

exclude_tags: Vec<String>

CSS selectors to exclude

only_main_content: bool

Extract only main content (default: true)

timeout: u64

Request timeout in milliseconds (default: 30000)

wait_for: u64

Wait time before scraping in milliseconds (default: 0)

remove_base64_images: bool

Remove base64 images (default: true)

skip_tls_verification: bool

Skip TLS verification

engine: String

Engine to use: “auto” | “http” | “browser” (default: “auto”)

wait_for_selector: Option<String>

CSS selector to wait for before scraping (browser only)

actions: Vec<BrowserAction>

Browser actions to perform before scraping

screenshot: bool

Capture screenshot (browser only)

screenshot_format: String

Screenshot format: “png” | “jpeg” (default: “png”)

Trait Implementations

impl Clone for ScrapeRequest

fn clone(&self) -> ScrapeRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ScrapeRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ScrapeRequest

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for ScrapeRequest

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.