lance_file::reader

Function batches_stream

Source 
pub fn batches_stream(
    reader: FileReader,
    projection: Schema,
    predicate: impl FnMut(&i32) -> bool + Send + Sync + 'static,
) -> impl RecordBatchStream
Expand description

Stream desired full batches from the file.

Parameters:

  • reader: An opened file reader.
  • projection: The schema of the returning RecordBatch.
  • predicate: A function that takes a batch ID and returns true if the batch should be returned.

Returns:

  • A stream of RecordBatchs, each one corresponding to one full batch in the file.