Expand description
Abstractions and implementations for writing data to delta tables
Structsยง
- A parquet writer implementation tailored to the needs of writing data to a delta table.
- Partition writer implementation This writer takes in table data as RecordBatches and writes it out to partitioned parquet files. It buffers data in memory until it reaches a certain size, then writes it out to optimize file sizes. When you complete writing you get back a list of Add actions that can be used to update the Delta table commit log.
- Write configuration for partition writers
- Configuration to write data into Delta tables