Structs§
- A batch encoder that encodes RecordBatch objects by delegating to field encoders for each top-level field in the batch.
- Keeps track of the current column index and makes a mapping from field id to column index
- The core array encoding strategy is a set of basic encodings that are generally applicable in most scenarios.
- The core field encoding strategy is a set of basic encodings that are generally applicable in most scenarios.
- An encoded array
- An encoded batch of data and a page table describing it
- An encoded page of data
- Options that control the encoding process
- Describes the size of a mini-block chunk of data
- Page data that has been compressed into a series of chunks put into a single buffer.
- A tool to reserve space for buffers that are not in-line with the data
- An encoding strategy used for 2.1+ files
Enums§
- Per-value compression must either:
Constants§
- The minimum alignment for a page buffer. Writers must respect this.
Traits§
- Encodes data from one format to another (hopefully more compact or useful) format
- A trait to pick which encoding strategy to use for a single page of data
- Trait for compression algorithms that compress an entire block of data into one opaque and self-described chunk.
- A trait to pick which compression to use for given data
- Top level encoding trait to code any Arrow array type into one or more pages.
- A trait to pick which kind of field encoding to use for a field
- Trait for compression algorithms that are suitable for use in the miniblock structural encoding
- Trait for compression algorithms that are suitable for use in the zipped structural encoding
- Trait for compression algorithms that are suitable for use in the zipped structural encoding
Functions§
- Helper method to encode a batch of data into memory
Type Aliases§
- A task to create a page of data