Struct arrow_ipc::gen::SparseTensor::SparseTensorIndexCSF
source · pub struct SparseTensorIndexCSF<'a> {
pub _tab: Table<'a>,
}
Expand description
Compressed Sparse Fiber (CSF) sparse tensor index.
Fields§
§_tab: Table<'a>
Implementations§
source§impl<'a> SparseTensorIndexCSF<'a>
impl<'a> SparseTensorIndexCSF<'a>
pub const VT_INDPTRTYPE: VOffsetT = 4u16
pub const VT_INDPTRBUFFERS: VOffsetT = 6u16
pub const VT_INDICESTYPE: VOffsetT = 8u16
pub const VT_INDICESBUFFERS: VOffsetT = 10u16
pub const VT_AXISORDER: VOffsetT = 12u16
pub unsafe fn init_from_table(table: Table<'a>) -> Self
pub fn create<'bldr: 'args, 'args: 'mut_bldr, 'mut_bldr>( _fbb: &'mut_bldr mut FlatBufferBuilder<'bldr>, args: &'args SparseTensorIndexCSFArgs<'args> ) -> WIPOffset<SparseTensorIndexCSF<'bldr>>
sourcepub fn indptrType(&self) -> Int<'a>
pub fn indptrType(&self) -> Int<'a>
CSF is a generalization of compressed sparse row (CSR) index. See smith2017knl
CSF index recursively compresses each dimension of a tensor into a set of prefix trees. Each path from a root to leaf forms one tensor non-zero index. CSF is implemented with two arrays of buffers and one arrays of integers.
For example, let X be a 2x3x4x5 tensor and let it have the following 8 non-zero values:
X[0, 0, 0, 1] := 1
X[0, 0, 0, 2] := 2
X[0, 1, 0, 0] := 3
X[0, 1, 0, 2] := 4
X[0, 1, 1, 0] := 5
X[1, 1, 1, 0] := 6
X[1, 1, 1, 1] := 7
X[1, 1, 1, 2] := 8
As a prefix tree this would be represented as:
0 1
/ \ |
0 1 1
/ / \ |
0 0 1 1
/| /| | /| |
1 2 0 2 0 0 1 2
The type of values in indptrBuffers
sourcepub fn indptrBuffers(&self) -> Vector<'a, Buffer>
pub fn indptrBuffers(&self) -> Vector<'a, Buffer>
indptrBuffers stores the sparsity structure.
Each two consecutive dimensions in a tensor correspond to a buffer in
indptrBuffers. A pair of consecutive values at indptrBuffers[dim][i]
and indptrBuffers[dim][i + 1]
signify a range of nodes in
indicesBuffers[dim + 1]
who are children of indicesBuffers[dim][i]
node.
For example, the indptrBuffers for the above X is:
indptrBuffer(X) = [
[0, 2, 3],
[0, 1, 3, 4],
[0, 2, 4, 5, 8]
].
sourcepub fn indicesType(&self) -> Int<'a>
pub fn indicesType(&self) -> Int<'a>
The type of values in indicesBuffers
sourcepub fn indicesBuffers(&self) -> Vector<'a, Buffer>
pub fn indicesBuffers(&self) -> Vector<'a, Buffer>
indicesBuffers stores values of nodes. Each tensor dimension corresponds to a buffer in indicesBuffers. For example, the indicesBuffers for the above X is:
indicesBuffer(X) = [
[0, 1],
[0, 1, 1],
[0, 0, 1, 1],
[1, 2, 0, 2, 0, 0, 1, 2]
].
Trait Implementations§
source§impl<'a> Clone for SparseTensorIndexCSF<'a>
impl<'a> Clone for SparseTensorIndexCSF<'a>
source§fn clone(&self) -> SparseTensorIndexCSF<'a>
fn clone(&self) -> SparseTensorIndexCSF<'a>
1.0.0 · source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source
. Read moresource§impl Debug for SparseTensorIndexCSF<'_>
impl Debug for SparseTensorIndexCSF<'_>
source§impl<'a> Follow<'a> for SparseTensorIndexCSF<'a>
impl<'a> Follow<'a> for SparseTensorIndexCSF<'a>
source§impl<'a> PartialEq<SparseTensorIndexCSF<'a>> for SparseTensorIndexCSF<'a>
impl<'a> PartialEq<SparseTensorIndexCSF<'a>> for SparseTensorIndexCSF<'a>
source§fn eq(&self, other: &SparseTensorIndexCSF<'a>) -> bool
fn eq(&self, other: &SparseTensorIndexCSF<'a>) -> bool
self
and other
values to be equal, and is used
by ==
.source§impl Verifiable for SparseTensorIndexCSF<'_>
impl Verifiable for SparseTensorIndexCSF<'_>
source§fn run_verifier(
v: &mut Verifier<'_, '_>,
pos: usize
) -> Result<(), InvalidFlatbuffer>
fn run_verifier( v: &mut Verifier<'_, '_>, pos: usize ) -> Result<(), InvalidFlatbuffer>
pos
in the verifier’s buffer.
Should not need to be called directly.