deltalake_core::operations

Module filesystem_check

Source
Expand description

Audit the Delta Table for active files that do not exist in the underlying filesystem and remove them.

Active files are ones that have an add action in the log, but no corresponding remove action. This operation creates a new transaction containing a remove action for each of the missing files.

This can be used to repair tables where a data file has been deleted accidentally or purposefully, if the file was corrupted.

§Example

let mut table = open_table("../path/to/table")?;
let (table, metrics) = FileSystemCheckBuilder::new(table.object_store(), table.state).await?;

Structs§

  • Audit the Delta Table’s active files with the underlying file system. See this module’s documentation for more information
  • Details of the FSCK operation including which files were removed from the log
  • A parsed path representation that can be safely written to object storage