Struct CrawlStartParams 

pub struct CrawlStartParams {

    pub url: String,
    pub name: Option<String>,
    pub extract_mode: Option<String>,
    pub extract_schema: Option<Value>,
    pub persona_id: Option<i64>,
    pub include_paths: Option<Vec<String>>,
    pub exclude_paths: Option<Vec<String>>,
    pub max_depth: Option<i64>,
    pub page_budget: Option<i64>,
    pub max_concurrent: Option<i64>,
    pub delay_ms: Option<i64>,
    pub respect_robots: Option<bool>,
    pub same_domain: Option<bool>,
    pub allow_subdomains: Option<bool>,
}

Body for POST /v1/crawl — start a Dragnet whole-site crawl. Only url is required (empty → the daemon 400s); every unset optional field is omitted from the wire body so the daemon fills its documented default.

Fields

url: String

Seed URL to crawl from (required).

name: Option<String>

Human label for the crawl (defaults daemon-side).

extract_mode: Option<String>

"markdown" (default) | "schema".

extract_schema: Option<Value>

JSON schema object driving schema extraction.

persona_id: Option<i64>

Persona to crawl as.

include_paths: Option<Vec<String>>

Path-regex allowlist.

exclude_paths: Option<Vec<String>>

Path-regex denylist.

max_depth: Option<i64>

Max link depth from the seed (default 3).

page_budget: Option<i64>

Hard cap on pages fetched (default 500).

max_concurrent: Option<i64>

In-process worker cap (default 4).

delay_ms: Option<i64>

Politeness delay between fetches, ms (default 250).

respect_robots: Option<bool>

Honor robots.txt (default true).

same_domain: Option<bool>

Stay on the seed’s domain (default true).

allow_subdomains: Option<bool>

Allow subdomains of the seed domain (default true).

Trait Implementations

impl Clone for CrawlStartParams

fn clone(&self) -> CrawlStartParams

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CrawlStartParams

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CrawlStartParams

fn default() -> CrawlStartParams

Returns the “default value” for a type.

impl Serialize for CrawlStartParams

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.