Expand description
Statically typed implementations of Arrow Arrays
See arrow_array for examples and usage instructions
Structs
- An generic representation of Arrow array data which encapsulates common attributes and operations for Arrow array. Specific operations for different arrays types (e.g., primitive, list, struct) are implemented in
Array
. - Builder for
ArrayData
type - An iterator that returns Some(T) or None, that can be used on any
ArrayAccessor
- An array of boolean values
- Builder for
BooleanBuffer
- Builder for
BooleanArray
- Builder for creating a Buffer object.
- Layout specification for a data type
- An array of dictionary encoded values
- An array of fixed size binary arrays
- Builder for
FixedSizeBinaryArray
- An array of [fixed length lists], similar to JSON arrays (e.g.
["A", "B"]
). - Builder for
FixedSizeListArray
- An array of variable length byte arrays
- Builder for
GenericByteArray
- Builder for
DictionaryArray
ofGenericByteArray
- Builder for
RunArray
ofGenericByteArray
- An array of variable length lists, similar to JSON arrays (e.g.
["A", "B", "C"]
). - Builder for
GenericListArray
- An array of key-value maps
- Builder for
MapArray
- An optional primitive value
- An array of null values
- Builder for
NullArray
- An array of primitive values
- Builder for
PrimitiveArray
- Builder for
DictionaryArray
ofPrimitiveArray
- Builder for
RunArray
ofPrimitiveArray
- An array of run-end encoded values
- An array of structs
- Builder for
StructArray
- A
DictionaryArray
typed on its child values array - A
RunArray
typed typed on its child values array - An array of values of varying types
- Builder for
UnionArray
Enums
- Layout specification for a single data type buffer
- Define capacities of child data or data buffers.
Traits
- A
DictionaryArray
with the key type erased - An array in the arrow columnar format
- A generic trait for accessing the values of an
Array
- Trait for dealing with different array builders at runtime
- Trait bridging the dynamic-typed nature of Arrow (via
DataType
) with the static-typed nature of rust types (ArrowNativeType
) for all types that implementArrowNativeType
. - An extension trait for
dyn Array
that provides ergonomic downcasting - A type that can be used within a variable-size array to encode offset information
Functions
- as_decimal_arrayDeprecatedForce downcast of an Array, such as an ArrayRef to Decimal128Array, panic’ing on failure.
- returns a comparison function that compares two values at two different positions between the two arrays. The arrays’ types must be equal.
- Downcasts a
dyn Array
to a concrete type - export_array_into_raw⚠DeprecatedExports an array to raw pointers of the C Data Interface provided by the consumer.
- Return the expected
DataTypeLayout
Arrays of this data type are expected to have - Constructs an array using the input
data
. Returns a reference-countedArray
instance. - Returns a builder with capacity
capacity
that corresponds to the datatypeDataType
This function is useful to construct arrays from an arbitrary vectors with known/expected schema. - Creates a new empty array
- Creates a new array of
data_type
of lengthlength
filled entirely ofNULL
values
Type Definitions
- A reference-counted reference to a generic
Array
- Builder for
BinaryArray
- Builder for
DictionaryArray
ofBinaryArray
- Builder for
RunArray
ofBinaryArray
- an iterator that returns Some(T) or None, that can be used on any BooleanArray
- A
PrimitiveArray
of days since UNIX epoch stored asi32
- Buffer builder for 32-bit date type.
- A 32-bit date array builder.
- A
PrimitiveArray
of milliseconds since UNIX epoch stored asi64
- Buffer builder for 64-bit date type.
- A 64-bit date array builder.
- A
PrimitiveArray
of 128-bit fixed point decimals - Buffer builder for 128-bit decimal type.
- A decimal 128 array builder
- A
PrimitiveArray
of 256-bit fixed point decimals - Buffer builder for 256-bit decimal type.
- A decimal 256 array builder
- A
PrimitiveArray
of elapsed durations in microseconds - Buffer builder for elaspsed time of microseconds unit.
- An elapsed time in microseconds array builder.
- A
PrimitiveArray
of elapsed durations in milliseconds - Buffer builder for elaspsed time of milliseconds unit.
- An elapsed time in milliseconds array builder.
- A
PrimitiveArray
of elapsed durations in nanoseconds - Buffer builder for elaspsed time of nanoseconds unit.
- An elapsed time in nanoseconds array builder.
- A
PrimitiveArray
of elapsed durations in seconds - Buffer builder for elaspsed time of second unit.
- An elapsed time in seconds array builder.
- Compare the values at two arbitrary indices in two arrays.
- an iterator that returns Some(T) or None, that can be used on any FixedSizeBinaryArray
- an iterator that returns Some(T) or None, that can be used on any FixedSizeListArray
- A
PrimitiveArray
off16
- Buffer builder for 16-bit floating point type.
- A 16-bit floating point array builder.
- A
PrimitiveArray
off32
- Buffer builder for 32-bit floating point type.
- A 32-bit floating point array builder.
- A
PrimitiveArray
off64
- Buffer builder for 64-bit floating point type.
- A 64-bit floating point array builder.
- A
GenericBinaryArray
for storing[u8]
- Array builder for
GenericBinaryArray
- an iterator that returns Some(T) or None, that can be used on any BinaryArray
- an iterator that returns Some(T) or None, that can be used on any ListArray
- A
GenericByteArray
for storingstr
- Array builder for
GenericStringArray
- an iterator that returns Some(T) or None, that can be used on any Utf8Array
- A
PrimitiveArray
ofi8
- Buffer builder for signed 8-bit integer type.
- A signed 8-bit integer array builder.
- A
DictionaryArray
indexed byi8
- A
PrimitiveArray
ofi16
- Buffer builder for signed 16-bit integer type.
- A signed 16-bit integer array builder.
- A
DictionaryArray
indexed byi16
- A
RunArray
withi16
run ends - A
PrimitiveArray
ofi32
- Buffer builder for signed 32-bit integer type.
- A signed 32-bit integer array builder.
- A
DictionaryArray
indexed byi32
- A
RunArray
withi32
run ends - A
PrimitiveArray
ofi64
- Buffer builder for signed 64-bit integer type.
- A signed 64-bit integer array builder.
- A
DictionaryArray
indexed byi64
- A
RunArray
withi64
run ends - A
PrimitiveArray
of “calendar” intervals in days and milliseconds - Buffer builder for “calendar” interval in days and milliseconds.
- A “calendar” interval in days and milliseconds array builder.
- A
PrimitiveArray
of “calendar” intervals in months, days, and nanoseconds - Buffer builder “calendar” interval in months, days, and nanoseconds.
- A “calendar” interval in months, days, and nanoseconds array builder.
- A
PrimitiveArray
of “calendar” intervals in months - Buffer builder for “calendar” interval in months.
- A “calendar” interval in months array builder.
- Builder for
LargeBinaryArray
- Builder for
DictionaryArray
ofLargeBinaryArray
- Builder for
RunArray
ofLargeBinaryArray
- A
GenericListArray
of variable size lists, storing offsets asi64
. - Builder for
LargeListArray
- Builder for
LargeStringArray
- Builder for
DictionaryArray
ofLargeStringArray
- Builder for
RunArray
ofLargeStringArray
- A
GenericListArray
of variable size lists, storing offsets asi32
. - Builder for
ListArray
- an iterator that returns Some(T) or None, that can be used on any MapArray
- an iterator that returns Some(T) or None, that can be used on any PrimitiveArray
- Builder for
StringArray
- Builder for
DictionaryArray
ofStringArray
- Builder for
RunArray
ofStringArray
- A
PrimitiveArray
of milliseconds since midnight stored asi32
- Buffer builder for 32-bit elaspsed time since midnight of millisecond unit.
- A 32-bit elaspsed time in milliseconds array builder.
- A
PrimitiveArray
of seconds since midnight stored asi32
- Buffer builder for 32-bit elaspsed time since midnight of second unit.
- A 32-bit elaspsed time in seconds array builder.
- A
PrimitiveArray
of microseconds since midnight stored asi64
- Buffer builder for 64-bit elaspsed time since midnight of microsecond unit.
- A 64-bit elaspsed time in microseconds array builder.
- A
PrimitiveArray
of nanoseconds since midnight stored asi64
- Buffer builder for 64-bit elaspsed time since midnight of nanosecond unit.
- A 64-bit elaspsed time in nanoseconds array builder.
- A
PrimitiveArray
of microseconds since UNIX epoch stored asi64
- Buffer builder for timestamp type of microsecond unit.
- A timestamp microsecond array builder.
- A
PrimitiveArray
of milliseconds since UNIX epoch stored asi64
- Buffer builder for timestamp type of millisecond unit.
- A timestamp millisecond array builder.
- A
PrimitiveArray
of nanoseconds since UNIX epoch stored asi64
- Buffer builder for timestamp type of nanosecond unit.
- A timestamp nanosecond array builder.
- A
PrimitiveArray
of seconds since UNIX epoch stored asi64
- Buffer builder for timestamp type of second unit.
- A timestamp second array builder.
- A
PrimitiveArray
ofu8
- Buffer builder for usigned 8-bit integer type.
- An usigned 8-bit integer array builder.
- A
DictionaryArray
indexed byu8
- A
PrimitiveArray
ofu16
- Buffer builder for usigned 16-bit integer type.
- An usigned 16-bit integer array builder.
- A
DictionaryArray
indexed byu16
- A
PrimitiveArray
ofu32
- Buffer builder for usigned 32-bit integer type.
- An usigned 32-bit integer array builder.
- A
DictionaryArray
indexed byu32
- A
PrimitiveArray
ofu64
- Buffer builder for usigned 64-bit integer type.
- An usigned 64-bit integer array builder.
- A
DictionaryArray
indexed byu64