Module column_values

fastfield_codecs

• Columnar storage of data for tantivy crate::Column.
• Encode data in different codecs.
• Monotonically map values to u64/u128

Structs

ColumnStats

Column statistics.

CompactSpaceU64Accessor

Exposes the compact space compressed values as u64.

EmptyColumnValues

Empty column of values.

VecColumn

VecColumn provides Column over a Vec<T>.

Enums

CodecType

Available codecs to use to encode the u64 (via MonotonicallyMappableToU64) converted data.

Constants

ALL_U64_CODEC_TYPES

List of all available u64-base codecs.

Traits

ColumnValues

ColumnValues provides access to a dense field column.

MonotonicallyMappableToU64

Monotonic maps a value to u64 value space. Monotonic mapping enables PartialOrd on u64 space without conversion to original space.

MonotonicallyMappableToU128

Montonic maps a value to u128 value space Monotonic mapping enables PartialOrd on u128 space without conversion to original space.

StrictlyMonotonicFn

Values need to be strictly monotonic mapped to a Internal value (u64 or u128) that can be used in fast field codecs.

Functions

load_u64_based_column_values

Load u64-based column values.

monotonic_map_column

Creates a view of a column transformed by a strictly monotonic mapping. See StrictlyMonotonicFn.

open_u128_as_compact_u64

Returns the u64 representation of the u128 data. The internal representation of the data as u64 is useful for faster processing.

open_u128_mapped

Returns the correct codec reader wrapped in the Arc for the data.

serialize_and_load_u64_based_column_values

Helper function to serialize a column (autodetect from all codecs) and then open it

serialize_column_values_u128

Serializes u128 values with the compact space codec.

serialize_u64_based_column_values

Serializes a given column of u64-mapped values.