Module shuffler

Source
Expand description

Shuffler is a component that takes a stream of record batches and shuffles them into the corresponding IVF partitions.

Structs§

IvfShuffler
IvfShufflerReader
SinglePartitionReader

Traits§

ShuffleReader
A reader that can read the shuffled partitions.
Shuffler
A shuffler that can shuffle the incoming stream of record batches into IVF partitions. Returns a IvfShuffleReader that can be used to read the shuffled partitions.