Skip to main content

RunStreamOptions

Struct RunStreamOptions 

Source
pub struct RunStreamOptions {
Show 16 fields pub state_store: Option<Arc<dyn StateStore>>, pub state_key: Option<String>, pub pipeline_name: Option<String>, pub row: Option<String>, pub run_id: Option<String>, pub dlq: Option<DlqConfig>, pub quality: Option<Arc<CompiledQuality>>, pub contract: Option<Arc<CompiledContract>>, pub masking: Option<Arc<CompiledMasking>>, pub adaptive: Option<AdaptiveBatchConfig>, pub cancel: Option<CancellationToken>, pub delivery: DeliveryMode, pub start_seq: u64, pub replay: Option<ReplayGuarantee>, pub resilience: Option<ResiliencePolicy>, pub schema_drift: Option<SchemaDriftPolicy>,
}

Fields§

§state_store: Option<Arc<dyn StateStore>>§state_key: Option<String>§pipeline_name: Option<String>§row: Option<String>§run_id: Option<String>§dlq: Option<DlqConfig>§quality: Option<Arc<CompiledQuality>>
Available on crate feature quality only.
§contract: Option<Arc<CompiledContract>>
Available on crate feature contract only.

Compiled data contract (issue #204). The pass runs per page after the quality pass and before the schema-drift pass.

§masking: Option<Arc<CompiledMasking>>
Available on crate feature masking only.

Compiled masking policy (issue #206). The pass runs per page first — before quality/contract/drift and every sink write — so PII never reaches a sink, the DLQ, or a lineage sample unmasked.

§adaptive: Option<AdaptiveBatchConfig>

Adaptive batch-size controller config; None (or enabled = false) leaves the per-page write path unchanged.

§cancel: Option<CancellationToken>

Cooperative cancellation. When set and cancelled mid-run, the streaming loop stops polling new pages, flushes the sinks (so a buffered sink like Parquet writes its footer / completes its upload rather than orphaning the file), and returns the partial result. Without this, a dropped run future loses everything written-but-unflushed (#146 H16).

§delivery: DeliveryMode

Delivery guarantee. AtLeastOnce (default) leaves the write path unchanged. ExactlyOnce enables the resume/skip + atomic-token path.

§start_seq: u64

Resume sequence read from the (unwrapped) exactly-once state value. Ignored unless delivery == ExactlyOnce. Defaults to 0.

§replay: Option<ReplayGuarantee>

The source’s replay capability, when the caller knows it. Some(NonDeterministic) steers an ExactlyOnce run away from the atomic-watermark skip path (whose correctness depends on positional replay) and onto the keyed-upsert mechanism when the sink is configured for it. None (default) trusts the caller — today’s behaviour for library users driving run_stream directly. Pipeline::run always sets it from Source::replay_guarantee().

§resilience: Option<ResiliencePolicy>

Optional resilience policy (retry/backoff/circuit-breaker/poison).

§schema_drift: Option<SchemaDriftPolicy>

Compiled schema-drift policy (issue #194). None → no drift handling.

Implementations§

Source§

impl RunStreamOptions

Source

pub fn new() -> Self

Source

pub fn with_state( self, store: Arc<dyn StateStore>, key: impl Into<String>, ) -> Self

Source

pub fn with_name(self, name: impl Into<String>) -> Self

Source

pub fn with_row(self, row: impl Into<String>) -> Self

Source

pub fn with_run_id(self, id: impl Into<String>) -> Self

Source

pub fn with_dlq(self, dlq: DlqConfig) -> Self

Source

pub fn with_cancel(self, cancel: CancellationToken) -> Self

Attach a cancellation token for cooperative, flush-completing cancel.

Source

pub fn with_adaptive(self, cfg: AdaptiveBatchConfig) -> Self

Attach an adaptive batch-size controller config.

Source

pub fn with_quality(self, quality: Arc<CompiledQuality>) -> Self

Available on crate feature quality only.
Source

pub fn with_contract(self, contract: Arc<CompiledContract>) -> Self

Available on crate feature contract only.

Attach a compiled data contract. The pass runs per page after the quality pass and before the schema-drift pass.

Source

pub fn with_masking(self, masking: Arc<CompiledMasking>) -> Self

Available on crate feature masking only.

Attach a compiled masking policy. The pass runs per page first — before quality/contract/drift and every sink write.

Source

pub fn with_delivery(self, mode: DeliveryMode) -> Self

Set the delivery mode.

Source

pub fn with_replay_guarantee(self, replay: ReplayGuarantee) -> Self

Set the resume sequence (exactly-once). Normally derived by Pipeline::run from the unwrapped state value. Declare the source’s replay capability (see the replay field).

Source

pub fn with_start_seq(self, seq: u64) -> Self

Source

pub fn with_resilience(self, policy: ResiliencePolicy) -> Self

Attach a resilience policy to the run.

Source

pub fn with_schema_drift(self, policy: SchemaDriftPolicy) -> Self

Attach a compiled schema-drift policy. The pass runs per page after the quality pass and before the sink write.

Trait Implementations§

Source§

impl Clone for RunStreamOptions

Source§

fn clone(&self) -> RunStreamOptions

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Default for RunStreamOptions

Source§

fn default() -> RunStreamOptions

Returns the “default value” for a type. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> DynClone for T
where T: Clone,

Source§

fn __clone_box(&self, _: Private) -> *mut ()

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> FutureExt for T

Source§

fn with_context(self, otel_cx: Context) -> WithContext<Self>

Attaches the provided Context to this type, returning a WithContext wrapper. Read more
Source§

fn with_current_context(self) -> WithContext<Self>

Attaches the current Context to this type, returning a WithContext wrapper. Read more
Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoRequest<T> for T

Source§

fn into_request(self) -> Request<T>

Wrap the input message T in a tonic::Request
Source§

impl<L> LayerExt<L> for L

Source§

fn named_layer<S>(&self, service: S) -> Layered<<L as Layer<S>>::Service, S>
where L: Layer<S>,

Applies the layer to a service and wraps it in Layered.
Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more