pub struct LogDataHandler<'a> { /* private fields */ }Expand description
Provides semanitc access to the log data.
This is a helper struct that provides access to the log data in a more semantic way to avid the necessiity of knowing the exact layout of the underlying log data.
Implementations§
Source§impl<'a> LogDataHandler<'a>
impl<'a> LogDataHandler<'a>
Sourcepub fn num_files(&self) -> usize
pub fn num_files(&self) -> usize
The number of files in the log data. Returns the total number of files represented across all underlying record batches.
Sourcepub fn iter(&self) -> impl Iterator<Item = LogicalFileView> + '_
pub fn iter(&self) -> impl Iterator<Item = LogicalFileView> + '_
Iterate over each file as a LogicalFileView without materializing all of them at once.
Trait Implementations§
Source§impl<'a> Clone for LogDataHandler<'a>
impl<'a> Clone for LogDataHandler<'a>
Source§impl DataFusionMixins for LogDataHandler<'_>
impl DataFusionMixins for LogDataHandler<'_>
Source§fn read_schema(&self) -> ArrowSchemaRef
fn read_schema(&self) -> ArrowSchemaRef
Source§fn input_schema(&self) -> ArrowSchemaRef
fn input_schema(&self) -> ArrowSchemaRef
ArrowSchemaRefSource§fn parse_predicate_expression(
&self,
expr: impl AsRef<str>,
session: &dyn Session,
) -> DeltaResult<Expr>
fn parse_predicate_expression( &self, expr: impl AsRef<str>, session: &dyn Session, ) -> DeltaResult<Expr>
ExprSource§impl IntoIterator for LogDataHandler<'_>
impl IntoIterator for LogDataHandler<'_>
Source§type Item = LogicalFileView
type Item = LogicalFileView
Source§type IntoIter = Box<dyn Iterator<Item = <LogDataHandler<'_> as IntoIterator>::Item>>
type IntoIter = Box<dyn Iterator<Item = <LogDataHandler<'_> as IntoIterator>::Item>>
Source§impl PruningStatistics for LogDataHandler<'_>
impl PruningStatistics for LogDataHandler<'_>
Source§fn min_values(&self, column: &Column) -> Option<ArrayRef>
fn min_values(&self, column: &Column) -> Option<ArrayRef>
return the minimum values for the named column, if known.
Note: the returned array must contain num_containers() rows
Source§fn max_values(&self, column: &Column) -> Option<ArrayRef>
fn max_values(&self, column: &Column) -> Option<ArrayRef>
return the maximum values for the named column, if known.
Note: the returned array must contain num_containers() rows.
Source§fn num_containers(&self) -> usize
fn num_containers(&self) -> usize
return the number of containers (e.g. row groups) being pruned with these statistics
Source§fn null_counts(&self, column: &Column) -> Option<ArrayRef>
fn null_counts(&self, column: &Column) -> Option<ArrayRef>
return the number of null values for the named column as an
Option<UInt64Array>.
Note: the returned array must contain num_containers() rows.
Source§fn row_counts(&self) -> Option<ArrayRef>
fn row_counts(&self) -> Option<ArrayRef>
return the number of rows in each container as an Option<UInt64Array>.
Note: the returned array must contain num_containers() rows
Source§fn contained(
&self,
column: &Column,
value: &HashSet<ScalarValue>,
) -> Option<BooleanArray>
fn contained( &self, column: &Column, value: &HashSet<ScalarValue>, ) -> Option<BooleanArray>
BooleanArray where each row represents information known
about specific literal values in a column. Read moreAuto Trait Implementations§
impl<'a> !RefUnwindSafe for LogDataHandler<'a>
impl<'a> !UnwindSafe for LogDataHandler<'a>
impl<'a> Forget for LogDataHandler<'a>
impl<'a> Freeze for LogDataHandler<'a>
impl<'a> Send for LogDataHandler<'a>
impl<'a> Sync for LogDataHandler<'a>
impl<'a> Unpin for LogDataHandler<'a>
impl<'a> UnsafeUnpin for LogDataHandler<'a>
Blanket Implementations§
Source§impl<T> AsAny for T
impl<T> AsAny for T
Source§fn any_ref(&self) -> &(dyn Any + Send + Sync + 'static)
fn any_ref(&self) -> &(dyn Any + Send + Sync + 'static)
dyn Any reference to the object: Read moreSource§fn as_any(self: Arc<T>) -> Arc<dyn Any + Send + Sync> ⓘ
fn as_any(self: Arc<T>) -> Arc<dyn Any + Send + Sync> ⓘ
Arc<dyn Any> reference to the object: Read moreSource§fn into_any(self: Box<T>) -> Box<dyn Any + Send + Sync>
fn into_any(self: Box<T>) -> Box<dyn Any + Send + Sync>
Box<dyn Any>: Read moreSource§fn type_name(&self) -> &'static str
fn type_name(&self) -> &'static str
std::any::type_name, since Any does not provide it and
Any::type_id is useless as a debugging aid (its Debug is just a mess of hex digits).Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<I, T> CollectInto<T> for I
impl<I, T> CollectInto<T> for I
Source§fn collect_into(self) -> T
fn collect_into(self) -> T
TSource§impl<T> FoldWithOption for T
impl<T> FoldWithOption for T
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more