Expand description
Automatically generated code from the Parquet thrift definition.
This module code generated from parquet.thrift. See crate::file for more information on reading Parquet encoded data.
See crate::file for easier to use APIs.
Structs§
- AesGcm
CtrV1 - AesGcm
V1 - Bloom
Filter Header - Bloom filter header is stored at beginning of Bloom filter data of each column and followed by its bitset.
- Boundary
Order - Enum to annotate whether lists of min/max elements inside ColumnIndex are ordered and if so, in which direction.
- Bson
Type - Embedded BSON logical type annotation
- Column
Chunk - Column
Index - Optional statistics for each data page in a ColumnChunk.
- Column
Meta Data - Description for column metadata
- Compression
Codec - Supported compression algorithms.
- Converted
Type - DEPRECATED: Common types used by frameworks(e.g. hive, pig) using parquet. ConvertedType is superseded by LogicalType. This enum should not be extended.
- Data
Page Header - Data page header
- Data
Page Header V2 - New page format allowing reading levels without decompressing the data Repetition and definition levels are uncompressed The remaining section containing the data is compressed if is_compressed is true
- Date
Type - Decimal
Type - Decimal logical type annotation
- Dictionary
Page Header - The dictionary page must be placed at the first position of the column chunk if it is partly or completely dictionary encoded. At most one dictionary page can be placed in a column chunk.
- Encoding
- Encodings supported by Parquet. Not all encodings are valid for all types. These enums are also used to specify the encoding of definition and repetition levels. See the accompanying doc for the details of the more complicated encodings.
- Encryption
With Column Key - Encryption
With Footer Key - Enum
Type - Field
Repetition Type - Representation of Schemas
- File
Crypto Meta Data - Crypto metadata for files with encrypted footer *
- File
Meta Data - Description for file metadata
- Float16
Type - Index
Page Header - IntType
- Integer logical type annotation
- Json
Type - Embedded JSON logical type annotation
- KeyValue
- Wrapper struct to store key values
- List
Type - MapType
- Micro
Seconds - Milli
Seconds - Time units for logical types
- Nano
Seconds - Null
Type - Logical type to annotate a column that is always null.
- Offset
Index - Optional offsets for each data page in a ColumnChunk.
- Page
Encoding Stats - statistics of a given page type and encoding
- Page
Header - Page
Location - Page
Type - RowGroup
- Schema
Element - Represents a element inside a schema definition.
- Size
Statistics - A structure for capturing metadata for estimating the unencoded, uncompressed size of data written. This is useful for readers to estimate how much memory is needed to reconstruct data in their memory model and for fine grained filter pushdown on nested structures (the histograms contained in this structure can help determine the number of nulls at a particular nesting level and maximum length of lists).
- Sorting
Column - Sort order within a RowGroup of a leaf column
- Split
Block Algorithm - Block-based algorithm type annotation. *
- Statistics
- Statistics per row group and per page All fields are optional.
- String
Type - Empty structs to use as logical type annotations
- Time
Type - Time logical type annotation
- Timestamp
Type - Timestamp logical type annotation
- Type
- Types supported by Parquet. These types are intended to be used in combination with the encodings to control the on disk storage format. For example INT16 is not included as a type since a good encoding of INT32 would handle this.
- Type
Defined Order - Empty struct to signal the order defined by the physical or logical type
- UUID
Type - Uncompressed
- The compression used in the Bloom filter.
- XxHash
- Hash strategy type annotation. xxHash is an extremely fast non-cryptographic hash algorithm. It uses 64 bits version of xxHash.