Module datafusion::execution

source ·
Expand description

Shared state for query planning and execution.

Re-exports

  • pub use crate::datasource::file_format::options;

Modules

  • config
  • context
    SessionContext contains methods for registering data sources and executing queries
  • disk_manager
    Manages files generated during query execution, files are hashed among the directories listed in RuntimeConfig::local_dirs.
  • memory_pool
    Manages all available memory during query execution
  • object_store
    ObjectStoreRegistry holds all the object stores at Runtime with a scheme for each store. This allows the user to extend DataFusion with different storage systems such as S3 or HDFS and query data inside these systems.
  • registry
    FunctionRegistry trait
  • runtime_env
    Execution RuntimeEnv environment that manages access to object store, memory manager, disk manager.

Structs

  • DiskManager
    Manages files generated during query execution, e.g. spill files generated while processing dataset larger than available memory.
  • TaskContext
    Task Execution Context

Traits

  • FunctionRegistry
    A registry knows how to build logical expressions out of user-defined function’ names