Skip to main content

Crate mocra_core

Crate mocra_core 

Source
Expand description

mocra-core — the mocra crawler framework’s runtime.

This crate holds the entire runtime: errors, cache service, utilities, shared domain models and runtime state, the downloader, the data-plane queue, coordination / sync, the scheduler, and the crawling engine + observability API (errors / cacheable / utils / common / downloader / queue / sync / schedule / engine). The host mocra crate is a thin facade over it.

Modules§

cacheable
common
Shared domain models, runtime state, and processing infrastructure.
downloader
engine
errors
queue
schedule
The DAG engine has been extracted into its own crate, mocra_dag.
sync
utils