Struct AppConfig 

pub struct AppConfig {
    pub server: ServerConfig,
    pub renderer: RendererConfig,
    pub crawler: CrawlerConfig,
    pub extraction: ExtractionConfig,
    pub auth: AuthConfig,
    pub request: RequestConfig,
    pub search: SearchConfig,
}

Fields

server: ServerConfig

renderer: RendererConfig

crawler: CrawlerConfig

extraction: ExtractionConfig

auth: AuthConfig

request: RequestConfig

search: SearchConfig

Implementations

impl AppConfig

pub fn load() -> Result<Self, ConfigError>

Load config from config.default.toml + environment variable overrides. Env vars use CRW_ prefix, __ as separator. E.g. CRW_SERVER__PORT=8080.

pub fn effective_deadline_ms( &self, requested_deadline_ms: Option<u64>, wait_for_ms: Option<u64>, ) -> u64

Compute the effective end-to-end request deadline (ms). Implements the issue-#35 auto-extension policy:

1. If the caller supplied an explicit requested_deadline_ms, return it verbatim — operators trust the request budget over our heuristic.
2. Otherwise, when request.auto_extend_deadline_for_ladder is on, return max(deadline_ms_default, ladder_min + wait_for_extra). ladder_min covers the configured tier ladder; wait_for_extra compensates for callers that bumped wait_for_ms above the default SPA budget (8s) — without it, a long wait_for would silently re-clamp inside CDP.
3. When the policy is disabled, return deadline_ms_default unchanged.

wait_for_ms is the per-request override (ScrapeRequest::wait_for / CrawlRequest::wait_for); pass None for sub-fetches that don’t surface a wait_for to the caller (search/map enrichment).

pub fn effective_request_timeout_secs(&self) -> u64

Tower middleware outer timeout (seconds). Must accommodate the longest legitimate handler runtime so a healthy request isn’t cancelled by the outer layer before the inner deadline fires.

Covers the three route envelopes:

• /scrape, /mcp — auto-extended scrape deadline.
• /search — SearXNG fetch + bounded enrichment fan-out (ceil(max_limit / max_concurrency) batches × scrape_ms).
• /crawl/jobs/:id, /map — handler-side caps up to 300s.

When auto-extend is disabled, returns the operator-configured baseline unchanged.

Trait Implementations

impl Clone for AppConfig

fn clone(&self) -> AppConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for AppConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for AppConfig

fn default() -> AppConfig

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for AppConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.