Module datafusion::execution
source · Expand description
Shared state for query planning and execution.
Re-exports§
pub use crate::datasource::file_format::options;
Modules§
SessionContext
contains methods for registering data sources and executing queries- Manages files generated during query execution, files are hashed among the directories listed in RuntimeConfig::local_dirs.
MemoryPool
for memory management during query execution, [proxy]
for help with allocation accounting.- ObjectStoreRegistry holds all the object stores at Runtime with a scheme for each store. This allows the user to extend DataFusion with different storage systems such as S3 or HDFS and query data inside these systems.
- FunctionRegistry trait
- Execution
RuntimeEnv
environment that manages access to object store, memory manager, disk manager.
Structs§
- Manages files generated during query execution, e.g. spill files generated while processing dataset larger than available memory.
- Task Execution Context
Traits§
- A registry knows how to build logical expressions out of user-defined function’ names
- Trait for types that stream arrow::record_batch::RecordBatch
Type Aliases§
- Trait for a
Stream
ofRecordBatch
es