Enum HarvestEvent 

pub enum HarvestEvent<'a> {
    BatchStarted {
        total_portals: usize,
    },
    PortalStarted {
        portal_index: usize,
        total_portals: usize,
        portal_name: &'a str,
        portal_url: &'a str,
    },
    ExistingDatasetsFound {
        count: usize,
    },
    PortalDatasetsFound {
        count: usize,
    },
    DatasetProcessed {
        current: usize,
        total: usize,
        created: usize,
        updated: usize,
        unchanged: usize,
        failed: usize,
        skipped: usize,
    },
    PortalCompleted {
        portal_index: usize,
        total_portals: usize,
        portal_name: &'a str,
        stats: &'a SyncStats,
    },
    PortalFailed {
        portal_index: usize,
        total_portals: usize,
        portal_name: &'a str,
        error: &'a str,
    },
    BatchCompleted {
        summary: &'a BatchHarvestSummary,
    },
    PortalCancelled {
        portal_index: usize,
        total_portals: usize,
        portal_name: &'a str,
        stats: &'a SyncStats,
    },
    BatchCancelled {
        completed_portals: usize,
        total_portals: usize,
    },
    StaleDetected {
        count: usize,
    },
    CircuitBreakerOpen {
        service: &'a str,
        retry_after: Duration,
    },
    PreprocessingStarted {
        total: usize,
    },
    PreprocessingCompleted {
        changed: usize,
        unchanged: usize,
        failed: usize,
    },
}

Events emitted during harvesting operations.

These events provide fine-grained progress information that consumers can use for logging, UI updates, or metrics collection.

Variants

BatchStarted

Batch harvest starting.

Fields

total_portals: usize

Total number of portals to harvest.

PortalStarted

Single portal harvest starting.

Fields

portal_index: usize

Zero-based index of the current portal.

total_portals: usize

Total number of portals in batch.

portal_name: &'a str

Portal name identifier.

portal_url: &'a str

Portal URL.

ExistingDatasetsFound

Found existing datasets in database for portal.

Fields

count: usize

Number of existing datasets.

PortalDatasetsFound

Found datasets on the portal.

Fields

count: usize

Number of datasets found.

DatasetProcessed

Progress update during dataset processing.

Fields

current: usize

Number of datasets processed so far.

total: usize

Total number of datasets to process.

created: usize

Counts by outcome type.

updated: usize

Number of updated datasets.

unchanged: usize

Number of unchanged datasets.

failed: usize

Number of failed datasets.

skipped: usize

Number of datasets skipped due to circuit breaker.

PortalCompleted

Single portal harvest completed successfully.

Fields

portal_index: usize

Zero-based index of the current portal.

total_portals: usize

Total number of portals in batch.

portal_name: &'a str

Portal name identifier.

stats: &'a SyncStats

Final statistics.

PortalFailed

Single portal harvest failed.

Fields

portal_index: usize

Zero-based index of the current portal.

total_portals: usize

Total number of portals in batch.

portal_name: &'a str

Portal name identifier.

error: &'a str

Error description.

BatchCompleted

Batch harvest completed.

Fields

summary: &'a BatchHarvestSummary

Aggregated summary of all portal results.

PortalCancelled

Single portal harvest was cancelled.

Fields

portal_index: usize

Zero-based index of the current portal.

total_portals: usize

Total number of portals in batch.

portal_name: &'a str

Portal name identifier.

stats: &'a SyncStats

Partial statistics at cancellation time.

BatchCancelled

Batch harvest was cancelled.

Fields

completed_portals: usize

Number of portals completed before cancellation.

total_portals: usize

Total number of portals in batch.

StaleDetected

Datasets marked as stale after a successful full sync.

Fields

count: usize

Number of datasets newly marked as stale.

CircuitBreakerOpen

Circuit breaker is open, harvest pausing/failing.

Fields

service: &'a str

Service name.

retry_after: Duration

Time until recovery attempt.

PreprocessingStarted

Pre-processing phase (delta detection / hash check) starting.

Fields

total: usize

Total number of datasets to pre-process.

PreprocessingCompleted

Pre-processing phase completed — summary before finalization steps (stale detection).

Note: in the streaming pipeline, preprocessing and persistence are interleaved, so this fires after both have completed.

Fields

changed: usize

Number of datasets that need persistence (created + updated).

unchanged: usize

Number of datasets with identical content hash.

failed: usize

Number of datasets that failed pre-processing.

Trait Implementations

impl<'a> Clone for HarvestEvent<'a>

fn clone(&self) -> HarvestEvent<'a>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Debug for HarvestEvent<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.