Module stream

Structs

ReadBatchTask

A task, emitted by a file reader, that will produce a batch (of the given size)

RowIdAndDeletesConfig

Configuration needed to apply row ids and deletions to a batch

Functions

apply_row_id_and_deletes

merge_streams

Given multiple streams of batch tasks, merge them into a single stream

wrap_with_row_id_and_delete

Given a stream of batch tasks this function will add a row ids column (if requested) and also apply a deletions vector to the batch.

Type Aliases

ReadBatchFut

ReadBatchFutStream

ReadBatchTaskStream