Module datafusion_python::datafusion_common::arrow::ipc::gen::Message
source · Structs§
- Optional compression for the memory buffers constituting IPC message bodies. Intended for use with RecordBatch but could be used for other message types
- Provided for forward compatibility in case we need to support different strategies for compressing the IPC message body (like whole-body compression rather than buffer-level) in the future
- For sending dictionary encoding information. Any Field can be dictionary-encoded, but in this case none of its children may be dictionary-encoded. There is one vector / column per dictionary, but that vector / column may be spread across multiple dictionary batches by using the isDelta flag
- A data header describing the shared memory layout of a “record” or “row” batch. Some systems call this a “row batch” internally and others a “record batch”.
Enums§
Constants§
- ENUM_
MAX_ BODY_ COMPRESSIO N_ METHOD Deprecated - ENUM_
MAX_ COMPRESSIO N_ TYPE Deprecated - ENUM_
MAX_ MESSAG E_ HEADER Deprecated - ENUM_
MIN_ BODY_ COMPRESSIO N_ METHOD Deprecated - ENUM_
MIN_ COMPRESSIO N_ TYPE Deprecated - ENUM_
MIN_ MESSAG E_ HEADER Deprecated - ENUM_
VALUE S_ BODY_ COMPRESSIO N_ METHOD Deprecated - ENUM_
VALUE S_ COMPRESSIO N_ TYPE Deprecated - ENUM_
VALUE S_ MESSAG E_ HEADER Deprecated
Functions§
- Verifies that a buffer of bytes contains a
Messageand returns it. Note that verification is still experimental and may not catch every error, or be maximally performant. For the previous, unchecked, behavior useroot_as_message_unchecked. - Assumes, without verification, that a buffer of bytes contains a Message and returns it.
- Verifies, with the given options, that a buffer of bytes contains a
Messageand returns it. Note that verification is still experimental and may not catch every error, or be maximally performant. For the previous, unchecked, behavior useroot_as_message_unchecked. - Verifies that a buffer of bytes contains a size prefixed
Messageand returns it. Note that verification is still experimental and may not catch every error, or be maximally performant. For the previous, unchecked, behavior usesize_prefixed_root_as_message_unchecked. - Assumes, without verification, that a buffer of bytes contains a size prefixed Message and returns it.
- Verifies, with the given verifier options, that a buffer of bytes contains a size prefixed
Messageand returns it. Note that verification is still experimental and may not catch every error, or be maximally performant. For the previous, unchecked, behavior useroot_as_message_unchecked.