Struct CompositeRepDefUnraveler

pub struct CompositeRepDefUnraveler { /* private fields */ }

As we decode we may extract rep/def information from multiple pages (or multiple chunks within a page).

For each chunk we create an unraveler. Each unraveler can have a completely different interpretation (e.g. one page might contain null items but no null structs and the next page might have null structs but no null items).

Concatenating these unravelers would be tricky and expensive so instead we have a composite unraveler which unravels across multiple unravelers.

Note: this class should be used even if there is only one page / unraveler. This is because the RepDefUnraveler’s API is more complex (it’s meant to be called by this class)

Implementations

impl CompositeRepDefUnraveler

pub fn new(unravelers: Vec<RepDefUnraveler>) -> Self

pub fn unravel_validity(&mut self, num_values: usize) -> Option<NullBuffer>

Unravels a layer of validity

Returns None if there are no null items in this layer

pub fn unravel_offsets<T: ArrowNativeType>( &mut self, ) -> Result<(OffsetBuffer<T>, Option<NullBuffer>)>

Unravels a layer of offsets (and the validity for that layer)

Trait Implementations

impl Debug for CompositeRepDefUnraveler

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.