Struct datafusion_execution::runtime_env::RuntimeEnv

pub struct RuntimeEnv {
    pub memory_pool: Arc<dyn MemoryPool>,
    pub disk_manager: Arc<DiskManager>,
    pub object_store_registry: Arc<dyn ObjectStoreRegistry>,
}

Execution runtime environment that manages system resources such as memory, disk and storage.

A RuntimeEnv is created from a RuntimeConfig and has the following resource management functionality:

• MemoryPool: Manage memory
• DiskManager: Manage temporary files on local disk
• ObjectStoreRegistry: Manage mapping URLs to object store instances

Fields

memory_pool: Arc<dyn MemoryPool>

Runtime memory management

disk_manager: Arc<DiskManager>

Manage temporary files during query execution

object_store_registry: Arc<dyn ObjectStoreRegistry>

Object Store Registry

Implementations

impl RuntimeEnv

pub fn new(config: RuntimeConfig) -> Result<Self>

Create env based on configuration

pub fn register_object_store( &self, url: &Url, object_store: Arc<dyn ObjectStore> ) -> Option<Arc<dyn ObjectStore>>

Registers a custom ObjectStore to be used with a specific url. This allows DataFusion to create external tables from urls that do not have built in support such as hdfs://namenode:port/....

Returns the ObjectStore previously registered for this scheme, if any.

See ObjectStoreRegistry for more details

pub fn object_store(&self, url: impl AsRef<Url>) -> Result<Arc<dyn ObjectStore>>

Retrieves a ObjectStore instance for a url by consulting the registry. See ObjectStoreRegistry::get_store for more details.

Trait Implementations

impl Clone for RuntimeEnv

fn clone(&self) -> RuntimeEnv

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RuntimeEnv

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for RuntimeEnv

fn default() -> Self

Returns the “default value” for a type.