Crate datafusion_execution

DataFusion execution configuration and runtime structures

Re-exports

• pub use disk_manager::DiskManager;
• pub use registry::FunctionRegistry;

Modules

• config
• disk_manager
  Manages files generated during query execution, files are hashed among the directories listed in RuntimeConfig::local_dirs.
• memory_pool
  Manages all available memory during query execution
• object_store
  ObjectStoreRegistry holds all the object stores at Runtime with a scheme for each store. This allows the user to extend DataFusion with different storage systems such as S3 or HDFS and query data inside these systems.
• registry
  FunctionRegistry trait
• runtime_env
  Execution RuntimeEnv environment that manages access to object store, memory manager, disk manager.

Structs

• TaskContext
  Task Execution Context

Traits

• RecordBatchStream
  Trait for types that stream [arrow::record_batch::RecordBatch]

Type Aliases

• SendableRecordBatchStream
  Trait for a Stream of [RecordBatch]es