Enum InputData 

pub enum InputData {
    JsonObject {
        data: Value,
        data_type: Option<Value>,
    },
    ArrowFile {
        path: PathBuf,
        batch_index: usize,
        column: Option<String>,
    },
}

Represents the data of an incoming input event for integration testing.

Variants

JsonObject

Converts the given JSON object to the closest Arrow representation.

An optional data type can be provided to guide the conversion.

Fields

data: Value

The input data as JSON.

This can be a JSON array, object, string, number, boolean, etc. Dora automatically converts the JSON to an Apache Arrow array, wrapping the data if needed (e.g. wrap bare integers into an array because Arrow requires all data to be in array form).

data_type: Option<Value>

Specifies the arrow DataType of the data field.

This field is optional. If not set, Dora will try to infer the data type automatically.

Use this field if the exact data type is important (e.g. to distinguish between different integer sizes).

ArrowFile

Load data from an Arrow IPC file.

The data must be in the Arrow IPC file format

Fields

path: PathBuf

The path to the Arrow IPC file.

batch_index: usize

The optional batch index to read from the file.

Arrow IPC files can contain multiple record batches. Only one batch is read per input event. This field specifies which batch to read. Defaults to 0.

column: Option<String>

Optional column name to read from the record batch.

If not set, the entire record batch is read and converted to an Arrow StructArray.

Trait Implementations

impl Clone for InputData

fn clone(&self) -> InputData

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InputData

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for InputData

fn deserialize<__D>( __deserializer: __D, ) -> Result<InputData, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for InputData

fn eq(&self, other: &InputData) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for InputData

fn serialize<__S>( &self, __serializer: __S, ) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Eq for InputData

impl StructuralPartialEq for InputData