Struct ParquetWriter

pub struct ParquetWriter<W> { /* private fields */ }

Available on crate feature parquet only.

Write a DataFrame to Parquet format.

Implementations

impl<W> ParquetWriter<W>

where W: Write,

pub fn new(writer: W) -> Self

where W: Write,

Create a new writer

pub fn with_compression(self, compression: ParquetCompression) -> Self

Set the compression used. Defaults to Zstd.

The default compression Zstd has very good performance, but may not yet been supported by older readers. If you want more compatibility guarantees, consider using Snappy.

pub fn with_statistics(self, statistics: StatisticsOptions) -> Self

Compute and write statistic

pub fn with_row_group_size(self, size: Option<usize>) -> Self

Set the row group size (in number of rows) during writing. This can reduce memory pressure and improve writing performance.

pub fn with_data_page_size(self, limit: Option<usize>) -> Self

Sets the maximum bytes size of a data page. If None will be 1024^2 bytes.

pub fn set_parallel(self, parallel: bool) -> Self

Serialize columns in parallel

pub fn batched(self, schema: &Schema) -> PolarsResult<BatchedWriter<W>>

pub fn finish(self, df: &mut DataFrame) -> PolarsResult<u64>

Write the given DataFrame in the writer W. Returns the total size of the file.