Module storage

Object storage backend abstraction layer for Delta Table transaction logs and data

Re-exports

• pub use retry_ext::ObjectStoreRetryExt;
• pub use object_store;
• pub use utils::*;

Modules

• file
  Local file storage backend. This backend read and write objects from local filesystem.
• retry_ext
  Retry extension for ObjectStore
• storage_constants
  Storage option keys to use when creating ObjectStore.
• utils
  Utility functions for working across Delta tables

Structs

• DeltaIOStorageBackend
  Wraps any object store and runs IO in it’s own runtime [EXPERIMENTAL]
• GetResult
  Result for a get request
• ListResult
  Result of a list call that includes objects, prefixes (directories) and a token for the next set of results. Individual result sets may be limited to 1,000 objects based on the underlying object storage’s limitations.
• ObjectMeta
  The metadata that describes an object.
• Path
  A parsed path representation that can be safely written to object storage
• RuntimeConfig
  Configuration for Tokio runtime
• StorageOptions
  Options used for configuring backend storage

Enums

• IORuntime
  Provide custom Tokio RT or a runtime config
• ObjectStoreError
  A specialized Error for object store-related errors

Constants

• DELIMITER
  The delimiter to separate object namespaces, creating a directory structure.

Traits

• ObjectStore
  Universal API to multiple object store services.
• ObjectStoreFactory
  Factory trait for creating ObjectStoreRef instances at runtime

Functions

• commit_uri_from_version
  Return the uri of commit version.
• factories
  TODO
• limit_store_handler
  Simple function to wrap the given ObjectStore in a LimitStore if configured
• store_for
  Simpler access pattern for the FactoryRegistry to get a single store
• str_is_truthy
  Return true for all the stringly values typically associated with true
• url_prefix_handler
  Simple function to wrap the given ObjectStore in a PrefixStore if necessary

Type Aliases

• DynObjectStore
  An alias for a dynamically dispatched object store implementation.
• FactoryRegistry
  TODO
• MultipartId
  Id type for multipart uploads.
• ObjectStoreRef
  Sharable reference to ObjectStore
• ObjectStoreResult
  A specialized Result for object store-related errors