Struct BatchedWriter

pub struct BatchedWriter<W: Write> { /* private fields */ }

Available on crate feature parquet only.

Implementations

impl<W: Write> BatchedWriter<W>

pub fn encode_and_compress<'a>( &'a self, df: &'a DataFrame, ) -> impl Iterator<Item = PolarsResult<RowGroupIterColumns<'static, PolarsError>>> + 'a

pub fn write_batch(&mut self, df: &DataFrame) -> PolarsResult<()>

Write a batch to the parquet writer.

Panics

The caller must ensure the chunks in the given DataFrame are aligned.

pub fn get_writer(&self) -> &Mutex<FileWriter<W>>

pub fn write_row_groups( &self, rgs: Vec<RowGroupIterColumns<'static, PolarsError>>, ) -> PolarsResult<()>

pub fn finish(&self) -> PolarsResult<u64>

Writes the footer of the parquet file. Returns the total size of the file.