Struct DeletionVectorDescriptor

pub struct DeletionVectorDescriptor {
    pub storage_type: StorageType,
    pub path_or_inline_dv: String,
    pub offset: Option<i32>,
    pub size_in_bytes: i32,
    pub cardinality: i64,
}

Defines a deletion vector

Fields

storage_type: StorageType

A single character to indicate how to access the DV. Legal options are: [‘u’, ‘i’, ‘p’].

path_or_inline_dv: String

Three format options are currently proposed:

• If storageType = 'u' then <random prefix - optional><base85 encoded uuid>: The deletion vector is stored in a file with a path relative to the data directory of this Delta table, and the file name can be reconstructed from the UUID. See Derived Fields for how to reconstruct the file name. The random prefix is recovered as the extra characters before the (20 characters fixed length) uuid.
• If storageType = 'i' then <base85 encoded bytes>: The deletion vector is stored inline in the log. The format used is the RoaringBitmapArray format also used when the DV is stored on disk and described in Deletion Vector Format.
• If storageType = 'p' then <absolute path>: The DV is stored in a file with an absolute path given by this path, which has the same format as the path field in the add/remove actions.

offset: Option<i32>

Start of the data for this DV in number of bytes from the beginning of the file it is stored in. Always None (absent in JSON) when storageType = 'i'.

size_in_bytes: i32

Size of the serialized DV in bytes (raw data size, i.e. before base85 encoding, if inline).

cardinality: i64

Number of rows the given DV logically removes from the file.

Implementations

impl DeletionVectorDescriptor

pub fn absolute_path(&self, parent: &Url) -> DeltaResult<Option<Url>>

get the absolute path of the deletion vector

Trait Implementations

impl Clone for DeletionVectorDescriptor

fn clone(&self) -> DeletionVectorDescriptor

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DeletionVectorDescriptor

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for DeletionVectorDescriptor

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for DeletionVectorDescriptor

fn eq(&self, other: &DeletionVectorDescriptor) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for DeletionVectorDescriptor

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Eq for DeletionVectorDescriptor

impl StructuralPartialEq for DeletionVectorDescriptor