Skip to main content

Module state_store

rust_scraper::infrastructure::export

Module state_store 

Source
Expand description

State Store for RAG Export Pipeline

Manages persistence of export state to support resume functionality. Tracks processed URLs to avoid duplicate exports.

§Design Decisions

  • proj-mod-by-feature: Organized by feature (export/state_store)
  • err-thiserror-lib: Uses project’s error system
  • mem-with-capacity: Pre-allocates when size is known
  • own-borrow-over-clone: Accepts references where possible

Structs§

StateStore
StateStore manages persistence of export state for a specific domain