Struct RepDefUnraveler

pub struct RepDefUnraveler { /* private fields */ }

Starts with serialized repetition and definition levels and unravels them into validity buffers and offsets buffers

This is used during decoding to create the necessary arrow structures

Implementations

impl RepDefUnraveler

pub fn new( rep_levels: Option<LevelBuffer>, def_levels: Option<LevelBuffer>, def_meaning: Arc<[DefinitionInterpretation]>, ) -> Self

Creates a new unraveler from serialized repetition and definition information

pub fn is_all_valid(&self) -> bool

pub fn max_lists(&self) -> usize

If the current level is a repetition layer then this returns the number of lists at this level.

This is not valid to call when the current level is a struct/primitive layer because in some cases there may be no rep or def information to know this.

pub fn unravel_offsets<T: ArrowNativeType>( &mut self, offsets: &mut Vec<T>, validity: Option<&mut BooleanBufferBuilder>, ) -> Result<()>

Unravels a layer of offsets from the unraveler into the given offset width

When decoding a list the caller should first unravel the offsets and then unravel the validity (this is the opposite order used during encoding)

pub fn skip_validity(&mut self)

pub fn unravel_validity(&mut self, validity: &mut BooleanBufferBuilder)

Unravels a layer of validity from the definition levels

Trait Implementations

impl Debug for RepDefUnraveler

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.