pub struct DeltaProviderReadStatsSnapshot {Show 28 fields
pub source_name: String,
pub snapshot_version: u64,
pub reader_backend: DeltaProviderReaderBackend,
pub scan_metadata_exhausted: Option<bool>,
pub scan_partitions_planned: u64,
pub files_planned: u64,
pub estimated_rows: Option<u64>,
pub estimated_bytes: Option<u64>,
pub datafusion_output_batch_size: Option<u64>,
pub scan_partitions_started: u64,
pub scan_partitions_completed: u64,
pub files_started: u64,
pub files_completed: u64,
pub dynamic_partition_files_pruned: u64,
pub dynamic_partition_files_kept: u64,
pub dynamic_filters_received: u64,
pub dynamic_filters_accepted: u64,
pub dynamic_filters_unsupported: u64,
pub dynamic_filter_snapshots: u64,
pub dynamic_partition_files_not_pruned_missing_metadata: u64,
pub dynamic_partition_files_not_pruned_unsupported_expression: u64,
pub batches_produced: u64,
pub rows_produced: u64,
pub deletion_vector_payloads_loaded: u64,
pub deletion_vectors_applied: u64,
pub deletion_vector_rows_deleted: u64,
pub deletion_vector_failures: u64,
pub deletion_vector_rejections: u64,
}Expand description
Immutable view of provider read progress for one physical scan.
Fields§
§source_name: StringDataFusion table name for this source.
snapshot_version: u64Delta snapshot version selected for this scan.
reader_backend: DeltaProviderReaderBackendProvider file-reader backend selected for this scan.
scan_metadata_exhausted: Option<bool>Whether metadata expansion exhausted the upstream kernel scan iterator.
scan_partitions_planned: u64Planned DataFusion execution partitions for this scan.
files_planned: u64Selected provider file tasks planned for this scan.
estimated_rows: Option<u64>Estimated output rows from planning when every selected file had stats.
estimated_bytes: Option<u64>Estimated bytes from planning when every selected file had a byte size.
datafusion_output_batch_size: Option<u64>Effective DataFusion task batch size observed when execution starts.
This records the upstream query-engine setting. It does not claim every produced or final query-output batch has exactly this many rows.
scan_partitions_started: u64Execution partitions whose stream was started by DataFusion.
scan_partitions_completed: u64Execution partitions whose stream reached normal completion.
files_started: u64File-read handoffs that were started.
files_completed: u64File-read handoffs that finished successfully.
dynamic_partition_files_pruned: u64File tasks skipped before read scheduling by dynamic partition pruning.
dynamic_partition_files_kept: u64File tasks kept after dynamic partition pruning evaluation.
dynamic_filters_received: u64Post-phase physical filters offered to the Delta dynamic filter hook.
dynamic_filters_accepted: u64Offered dynamic filters retained for partition pruning.
dynamic_filters_unsupported: u64Offered filters rejected by the dynamic filter hook policy.
dynamic_filter_snapshots: u64Attempts to snapshot a retained dynamic filter during file admission.
dynamic_partition_files_not_pruned_missing_metadata: u64Kept file tasks with missing, invalid, or unparsable partition metadata.
dynamic_partition_files_not_pruned_unsupported_expression: u64Kept file tasks with unsupported or failed dynamic partition evaluation.
batches_produced: u64Record batches sent toward DataFusion.
rows_produced: u64Rows sent toward DataFusion after transform and DV filtering.
deletion_vector_payloads_loaded: u64Deletion-vector payloads loaded for selected files.
deletion_vectors_applied: u64Deletion-vector masks applied to selected files.
deletion_vector_rows_deleted: u64Rows removed by deletion-vector masks when known.
deletion_vector_failures: u64Deletion-vector read or masking failures.
deletion_vector_rejections: u64Deletion-vector reads rejected by safety gates.
Trait Implementations§
Source§impl Clone for DeltaProviderReadStatsSnapshot
impl Clone for DeltaProviderReadStatsSnapshot
Source§fn clone(&self) -> DeltaProviderReadStatsSnapshot
fn clone(&self) -> DeltaProviderReadStatsSnapshot
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read moreimpl Eq for DeltaProviderReadStatsSnapshot
Source§impl PartialEq for DeltaProviderReadStatsSnapshot
impl PartialEq for DeltaProviderReadStatsSnapshot
Source§fn eq(&self, other: &DeltaProviderReadStatsSnapshot) -> bool
fn eq(&self, other: &DeltaProviderReadStatsSnapshot) -> bool
self and other values to be equal, and is used by ==.impl StructuralPartialEq for DeltaProviderReadStatsSnapshot
Auto Trait Implementations§
impl Freeze for DeltaProviderReadStatsSnapshot
impl RefUnwindSafe for DeltaProviderReadStatsSnapshot
impl Send for DeltaProviderReadStatsSnapshot
impl Sync for DeltaProviderReadStatsSnapshot
impl Unpin for DeltaProviderReadStatsSnapshot
impl UnsafeUnpin for DeltaProviderReadStatsSnapshot
impl UnwindSafe for DeltaProviderReadStatsSnapshot
Blanket Implementations§
impl<T> Allocation for T
Source§impl<T> AsAny for T
impl<T> AsAny for T
Source§fn any_ref(&self) -> &(dyn Any + Send + Sync + 'static)
fn any_ref(&self) -> &(dyn Any + Send + Sync + 'static)
dyn Any reference to the object: Read moreSource§fn as_any(self: Arc<T>) -> Arc<dyn Any + Send + Sync> ⓘ
fn as_any(self: Arc<T>) -> Arc<dyn Any + Send + Sync> ⓘ
Arc<dyn Any> reference to the object: Read moreSource§fn into_any(self: Box<T>) -> Box<dyn Any + Send + Sync>
fn into_any(self: Box<T>) -> Box<dyn Any + Send + Sync>
Box<dyn Any>: Read moreSource§fn type_name(&self) -> &'static str
fn type_name(&self) -> &'static str
std::any::type_name, since Any does not provide it and
Any::type_id is useless as a debugging aid (its Debug is just a mess of hex digits).Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> DynPartialEq for T
impl<T> DynPartialEq for T
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key and return true if they are equal.Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more