Module pb

Protobuf definitions for Lance Format

Modules

• data_fragment
  Nested message and enum types in DataFragment.
• deletion_file
  Nested message and enum types in DeletionFile.
• encoded_u64_array
  Nested message and enum types in EncodedU64Array.
• manifest
  Nested message and enum types in Manifest.
• transaction
  Nested message and enum types in Transaction.
• u64_segment
  Nested message and enum types in U64Segment.

Structs

• BTreeIndexDetails
  Currently these are all empty messages because all needed details are either hard-coded (e.g. filenames) or stored in the index itself. However, we may want to add more details in the future, in particular we can add details that may be useful for planning queries (e.g. don’t force us to load the index until we know we need it)
• BitmapIndexDetails
• DataFile
  Lance Data File
• DataFragment
  Data fragment. A fragment is a set of files which represent the different columns of the same rows. If column exists in the schema, but the related file does not exist, treat this column as nulls.
• DeletionFile
  Deletion File
• EncodedU64Array
  / A basic bitpacked array of u64 values.
• ExternalFile
• IndexMetadata
  Metadata describing the index.
• IndexSection
  Index Section, containing a list of index metadata for one dataset version.
• InvertedIndexDetails
• LabelListIndexDetails
• Manifest
  Manifest is a global section shared between all the files.
• RowIdSequence
  / A sequence of row IDs. This is split up into one or more segments, / each of which can be encoded in different ways. The encodings are optimized / for values that are sorted, which will often be the case with row ids. / They also have optimized forms depending on how sparse the values are.
• Transaction
  A transaction represents the changes to a dataset.
• U64Segment
  / Different ways to encode a sequence of u64 values.
• Uuid
  / UUID type. encoded as 16 bytes.
• VectorIndexDetails
• VersionAuxData
  Auxiliary Data attached to a version. Only load on-demand.