lance_index::vector::v3

Module shuffler

Source
Expand description

Shuffler is a component that takes a stream of record batches and shuffles them into the corresponding IVF partitions.

Structs§

Traits§

  • ShuffleReader
    A reader that can read the shuffled partitions.
  • Shuffler
    A shuffler that can shuffle the incoming stream of record batches into IVF partitions. Returns a IvfShuffleReader that can be used to read the shuffled partitions.