Struct CrawlStats 

pub struct CrawlStats {
    pub pages_discovered: usize,
    pub pages_fetched: usize,
    pub pages_parsed: usize,
    pub pages_skipped: usize,
    pub pages_failed: usize,
    pub assets_discovered: usize,
    pub assets_downloaded: usize,
    pub assets_failed: usize,
    pub ocr_attempted: usize,
    pub ocr_succeeded: usize,
    pub ocr_unavailable: usize,
}

Crawl and extraction counters.

Fields

pages_discovered: usize

URLs discovered through seeds, sitemaps, or links.

pages_fetched: usize

Page fetches attempted successfully enough to produce a response.

pages_parsed: usize

HTML pages parsed and written.

pages_skipped: usize

Pages skipped by content type, robots, or policy.

pages_failed: usize

Pages that failed permanently.

assets_discovered: usize

Asset URLs discovered while parsing pages.

assets_downloaded: usize

Assets downloaded successfully.

assets_failed: usize

Assets that failed to download.

ocr_attempted: usize

OCR attempts made for candidate assets.

ocr_succeeded: usize

OCR attempts that produced usable text.

ocr_unavailable: usize

OCR attempts skipped because the backend was unavailable.

Trait Implementations

impl Clone for CrawlStats

fn clone(&self) -> CrawlStats

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CrawlStats

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CrawlStats

fn default() -> CrawlStats

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for CrawlStats

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for CrawlStats

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.