Expand description
APIs to read from Parquet format.
Re-exports§
pub use schema::infer_schema;
pub use schema::FileMetadata;
pub use crate::parquet::error::ParquetError;
pub use crate::parquet::metadata::ColumnChunkMetadata;
pub use crate::parquet::metadata::ColumnDescriptor;
pub use crate::parquet::metadata::RowGroupMetadata;
pub use crate::parquet::page::CompressedDataPage;
pub use crate::parquet::page::DataPageHeader;
pub use crate::parquet::page::Page;
pub use crate::parquet::read::decompress;
pub use crate::parquet::read::get_column_iterator;
pub use crate::parquet::read::read_metadata as _read_metadata;
pub use crate::parquet::read::BasicDecompressor;
pub use crate::parquet::read::MutStreamingIterator;
pub use crate::parquet::read::PageReader;
pub use crate::parquet::read::ReadColumnIterator;
pub use crate::parquet::read::State;
pub use crate::parquet::schema::types::GroupLogicalType;
pub use crate::parquet::schema::types::ParquetType;
pub use crate::parquet::schema::types::PhysicalType;
pub use crate::parquet::schema::types::PrimitiveConvertedType;
pub use crate::parquet::schema::types::PrimitiveLogicalType;
pub use crate::parquet::schema::types::TimeUnit as ParquetTimeUnit;
pub use crate::parquet::types::int96_to_i64_ns;
pub use crate::parquet::fallible_streaming_iterator;
Modules§
- APIs to handle Parquet <-> Arrow schemas.
- APIs exposing
crate::parquet
’s statistics as arrow’s statistics.
Structs§
- The state of nested data types.
Enums§
- The initial info of nested data types. The
bool
indicates if the type is nullable.
Traits§
- A fallible, streaming iterator.
Functions§
- An iterator adapter that maps multiple iterators of [
PagesIter
] into an iterator ofArray
s. - Creates a new
ListArray
orFixedSizeListArray
. - Creates a new
MapArray
. - Returns all
ColumnChunkMetadata
associated tofield_name
. For non-nested parquet types, this returns a single column - Creates a new iterator of compressed pages.
- Initialize
NestedState
from&[InitNested]
. - Returns the number of (parquet) columns that a
ArrowDataType
contains. - Reads parquets’ metadata synchronously.