Module lance_core::io

IO utilities for Lance Columnar Format.

Re-exports

• pub use object_reader::CloudObjectReader;
• pub use object_writer::ObjectWriter;
• pub use reader::FileReader;
• pub use writer::FileWriter;

Modules

• commit
  Trait for commit implementations.
• deletion
• local
  Optimized local I/Os
• object_reader
• object_store
  Extend object_store::ObjectStore functionalities
• object_writer
• reader
  Lance Data File Reader
• writer

Structs

• RecordBatchStreamAdapter
  Combines a [Stream] with a SchemaRef implementing RecordBatchStream for the combination

Enums

• ReadBatchParams
  Parameter to be used to read a batch.

Traits

• Reader
• RecordBatchStream
  RecordBatch Stream trait.
• WriteExt
  Lance Write Extension.
• Writer
  A trait for writing to a file on local file system or object store.

Functions

• read_binary_array
  Read a binary array from a Reader.
• read_fixed_stride_array
  Read a fixed stride array from disk.
• read_message
  Read a protobuf message at file position ‘pos’.
• read_message_from_buf
  Read protobuf from a buffer.
• read_metadata_offset
• read_struct
  Read a Protobuf-backed struct at file position: pos.
• read_struct_from_buf
  Read a Protobuf-backed struct from a buffer.
• write_manifest
  Write manifest to an open file.