Struct Args 

pub struct Args {
    pub url: String,
    pub force_refresh: bool,
    pub ignore_robots: bool,
    pub user_agent: Option<String>,
    pub timeout_secs: Option<u64>,
    pub rate_limit_rpm: Option<u32>,
    pub per_host_concurrency: Option<u32>,
    pub global_concurrency: Option<u32>,
    pub max_retries: Option<u8>,
    pub max_tokens: Option<usize>,
    pub summarize: Option<String>,
}

Fields

url: String

force_refresh: bool

ignore_robots: bool

user_agent: Option<String>

Override [fetch] user_agent for this request.

timeout_secs: Option<u64>

Override [fetch] timeout_secs (per-request timeout) for this request.

rate_limit_rpm: Option<u32>

per_host_concurrency: Option<u32>

global_concurrency: Option<u32>

max_retries: Option<u8>

max_tokens: Option<usize>

Auto-summarize when the extracted markdown exceeds N tokens. Runs the configured [summarization] backend (the offline extractive backend by default) and replaces the body with a summary sized toward the budget (best-effort; may land a few tokens over).

summarize: Option<String>

JSON SummarizeOpts blob — same shape as the MCP summarize tool args minus the url field, e.g. --summarize '{"mode":"abstractive","target_tokens":500}'. Applied before --max-tokens; the body is replaced with the summary.