datafusion_physical_plan::common

Function compute_record_batch_statistics

Source 
pub fn compute_record_batch_statistics(
    batches: &[Vec<RecordBatch>],
    schema: &Schema,
    projection: Option<Vec<usize>>,
) -> Statistics
Expand description

Computes the statistics for an in-memory RecordBatch

Only computes statistics that are in arrows metadata (num rows, byte size and nulls) and does not apply any kernel on the actual data.