Enum Event 

#[non_exhaustive]
pub enum Event {
    Input {
        id: DataId,
        metadata: Metadata,
        data: ArrowData,
    },
    InputClosed {
        id: DataId,
    },
    InputRecovered {
        id: DataId,
    },
    NodeRestarted {
        id: NodeId,
    },
    Stop(StopCause),
    Reload {
        operator_id: Option<OperatorId>,
    },
    ParamUpdate {
        key: String,
        value: Value,
    },
    ParamDeleted {
        key: String,
    },
    NodeFailed {
        affected_input_ids: Vec<DataId>,
        error: String,
        source_node_id: NodeId,
    },
    Error(String),
}

Represents an incoming Dora event.

Events might be triggered by other nodes, by Dora itself, or by some external user input.

It’s safe to ignore event types that are not relevant to the node.

This enum is marked as non_exhaustive because we might add additional variants in the future. Please ignore unknown event types instead of throwing an error to avoid breakage when updating Dora.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

Input

An input was received from another node.

This event corresponds to one of the inputs of the node as specified in the dataflow YAML file.

Fields

id: DataId

The input ID, as specified in the YAML file.

Note that this is not the output ID of the sender, but the ID assigned to the input in the YAML file.

metadata: Metadata

Meta information about this input, e.g. the timestamp.

data: ArrowData

The actual data in the Apache Arrow data format.

InputClosed

An input was closed by the sender.

The sending node mapped to an input exited, so this input will receive no more data.

Fields

id: DataId

The ID of the input that was closed, as specified in the YAML file.

Note that this is not the output ID of the sender, but the ID assigned to the input in the YAML file.

InputRecovered

A previously closed input has recovered and will receive data again.

This happens when an upstream node that timed out (via input_timeout) starts producing data again. The circuit breaker automatically re-opens the input.

Fields

id: DataId

The ID of the recovered input, as specified in the YAML file.

NodeRestarted

An upstream node has restarted.

Sent to downstream nodes when a node with a restart policy successfully restarts after a failure. Nodes can use this to reset state, clear caches, or log the recovery.

Fields

id: NodeId

The ID of the upstream node that restarted.

Stop(StopCause)

Notification that the event stream is about to close.

The StopCause field contains the reason for the event stream closure.

Nodes should exit once the event stream closes.

Reload

Instructs the node to reload itself or one of its operators.

This event is currently only used for reloading Python operators that are started by a dora runtime process. So this event should not be sent to normal nodes yet.

Fields

operator_id: Option<OperatorId>

The ID of the operator that should be reloaded.

There is currently no case where operator_id is None.

ParamUpdate

A runtime parameter has been updated via dora param set.

Nodes can use this to dynamically adjust behavior (e.g., thresholds, rates) without restarting.

Fields

key: String

The parameter key that was set.

value: Value

The new JSON value.

ParamDeleted

A runtime parameter has been deleted via dora param delete.

Nodes can use this to remove local overrides and fall back to defaults.

Fields

key: String

The parameter key that was deleted.

NodeFailed

An upstream node has failed.

Sent to downstream nodes when an upstream node exits with a non-zero exit code. Downstream nodes can use this to handle the failure gracefully (e.g. switch to cached data, log, retry).

Fields

affected_input_ids: Vec<DataId>

The IDs of the inputs affected by the failure.

error: String

Human-readable error message from the failed node.

source_node_id: NodeId

The ID of the node that failed.

Error(String)

Notifies the node about an unexpected error that happened inside Dora.

It’s a good idea to output or log this error for debugging.

Trait Implementations

impl Debug for Event

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.