pub struct BoundedExecutor { /* private fields */ }Expand description
Parse a file in bounded batches to stay within a memory budget.
Implementations§
Source§impl BoundedExecutor
impl BoundedExecutor
pub fn new(budget: MemoryBudget) -> Self
Sourcepub fn run<P>(
&self,
path: &Path,
splitter: &dyn Splitter,
parser: P,
plan: ExecutionPlan,
prefault: bool,
) -> Result<Vec<RecordBatch>>
pub fn run<P>( &self, path: &Path, splitter: &dyn Splitter, parser: P, plan: ExecutionPlan, prefault: bool, ) -> Result<Vec<RecordBatch>>
Parse path in batches, returning one RecordBatch per batch.
The caller is responsible for concatenating the batches if a single table is desired.
Auto Trait Implementations§
impl Freeze for BoundedExecutor
impl RefUnwindSafe for BoundedExecutor
impl Send for BoundedExecutor
impl Sync for BoundedExecutor
impl Unpin for BoundedExecutor
impl UnsafeUnpin for BoundedExecutor
impl UnwindSafe for BoundedExecutor
Blanket Implementations§
impl<T> Allocation for T
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more