Module operations

High level operations API to interact with Delta tables

At the heart of the high level operations APIs is the DeltaOps struct, which consumes a DeltaTable and exposes methods to attain builders for several high level operations. The specific builder structs allow fine-tuning the operations’ behaviors and will return an updated table potentially in conjunction with a data stream, if the operation returns data as well.

Modules

• add_column
  Add a new column to a table
• add_feature
  Enable table features
• cast
  Provide common cast functionality for callers
• constraints
  Add a check constraint to a table
• convert_to_delta
  Command for converting a Parquet table to a Delta table in place
• create
  Command for creating a new delta table
• delete
  Delete records from a Delta Table that statisfy a predicate
• drop_constraints
  Drop a constraint from a table
• filesystem_check
  Audit the Delta Table for active files that do not exist in the underlying filesystem and remove them.
• load_cdf
  Module for reading the change datafeed of delta tables
• merge
  Merge data from a source dataset with the target Delta Table based on a join predicate. A full outer join is performed which results in source and target records that match, source records that do not match, or target records that do not match.
• optimize
  Optimize a Delta Table
• restore
  Perform restore of delta table to a specified version or datetime
• set_tbl_properties
  Set table properties on a table
• transaction
  Add a commit entry to the Delta Table. This module provides a unified interface for modifying commit behavior and attributes
• update
  Update records from a Delta Table for records statisfy a predicate
• vacuum
  Vacuum a Delta table
• write
  New Table Semantics
• writer
  Abstractions and implementations for writing data to delta tables

Structs

• DeltaOps
  High level interface for executing commands against a DeltaTable

Functions

• collect_sendable_stream
  Create a vector of record batches from a stream
• get_num_idx_cols_and_stats_columns
  Get the num_idx_columns and stats_columns from the table configuration in the state If table_config does not exist (only can occur in the first write action) it takes the configuration that was passed to the writerBuilder.