Struct GTFConfig 

pub struct GTFConfig {
    pub batch_size: usize,
    pub file_schema: SchemaRef,
    pub object_store: Arc<dyn ObjectStore>,
    pub projection: Option<Vec<usize>>,
}

Configuration for a GTF data source.

Fields

batch_size: usize

The number of rows to read at a time.

file_schema: SchemaRef

The schema of the GTF file. This is static.

object_store: Arc<dyn ObjectStore>

The object store to use for reading GTF files.

projection: Option<Vec<usize>>

Any projections to apply to the resulting batches.

Implementations

impl GTFConfig

pub fn new(object_store: Arc<dyn ObjectStore>, file_schema: SchemaRef) -> Self

Create a new GTF configuration.

pub fn with_schema(self, file_schema: SchemaRef) -> Self

Set the file schema.

pub fn with_batch_size(self, batch_size: usize) -> Self

Set the batch size.

pub fn with_projection(self, projection: Vec<usize>) -> Self

Set the projection.

pub fn with_some_projection(self, projection: Option<Vec<usize>>) -> Self

Set the projection from an optional vector.