SplitNode

Struct SplitNode 

Source
pub struct SplitNode { /* private fields */ }
Expand description

Split node - fan-out iterator.

Takes an array field from the input and emits each element as a separate output. This enables “for each item” processing patterns.

§Ports

  • Input: “in” - Data containing an array field
  • Output: “out” - Emitted for each item in the array
  • Output: “done” - Emitted when all items have been processed
  • Output: “error” - Emitted on errors

§Example Configuration

nodes:
  process_items:
    type: std::split
    config:
      field: $.items          # Array field to iterate
      mode: parallel          # sequential | parallel | batched
      batch_size: 10          # Only for batched mode
    inputs:
      - from: fetch_data.out -> in
    outputs:
      out: -> process_item.in
      done: -> finalize.in

Implementations§

Source§

impl SplitNode

Source

pub fn new(field: impl Into<String>) -> Self

Create a split node that iterates over the specified field.

Source

pub fn sequential(field: impl Into<String>) -> Self

Create a split node with sequential processing.

Source

pub fn parallel(field: impl Into<String>) -> Self

Create a split node with parallel processing.

Source

pub fn batched(field: impl Into<String>, batch_size: usize) -> Self

Create a split node with batched processing.

Source

pub fn with_mode(self, mode: SplitMode) -> Self

Set the processing mode.

Trait Implementations§

Source§

impl Debug for SplitNode

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Node for SplitNode

Source§

fn info(&self) -> NodeInfo

Get metadata about this node.
Source§

fn execute<'a>( &'a self, ctx: Context, inputs: HashMap<String, RelPtr<()>>, ) -> NodeFuture<'a>

Execute the node. Read more
Source§

fn shutdown(&self)

Called when the node is being shut down.
Source§

fn output_schema_hash(&self) -> u64

Get the schema hash for this node’s output type.

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> ArchivePointee for T

Source§

type ArchivedMetadata = ()

The archived version of the pointer metadata for this type.
Source§

fn pointer_metadata( _: &<T as ArchivePointee>::ArchivedMetadata, ) -> <T as Pointee>::Metadata

Converts some archived metadata to the pointer metadata for itself.
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> LayoutRaw for T

Source§

fn layout_raw(_: <T as Pointee>::Metadata) -> Result<Layout, LayoutError>

Returns the layout of the type.
Source§

impl<T, N1, N2> Niching<NichedOption<T, N1>> for N2
where T: SharedNiching<N1, N2>, N1: Niching<T>, N2: Niching<T>,

Source§

unsafe fn is_niched(niched: *const NichedOption<T, N1>) -> bool

Returns whether the given value has been niched. Read more
Source§

fn resolve_niched(out: Place<NichedOption<T, N1>>)

Writes data to out indicating that a T is niched.
Source§

impl<T> Pointee for T

Source§

type Metadata = ()

The metadata type for pointers and references to this type.
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more