Expand description
Protobuf definitions for Lance Format
Modules§
- Nested message and enum types in
DataFragment
. - Nested message and enum types in
DeletionFile
. - Nested message and enum types in
EncodedU64Array
. - Nested message and enum types in
Manifest
. - Nested message and enum types in
Transaction
. - Nested message and enum types in
U64Segment
.
Structs§
- Lance Data File
- Data fragment. A fragment is a set of files which represent the different columns of the same rows. If column exists in the schema, but the related file does not exist, treat this column as nulls.
- Deletion File
- / A basic bitpacked array of u64 values.
- Metadata describing the index.
- Index Section, containing a list of index metadata for one dataset version.
- Manifest is a global section shared between all the files.
- / A sequence of row IDs. This is split up into one or more segments, / each of which can be encoded in different ways. The encodings are optimized / for values that are sorted, which will often be the case with row ids. / They also have optimized forms depending on how sparse the values are.
- A transaction represents the changes to a dataset.
- / Different ways to encode a sequence of u64 values.
- / UUID type. encoded as 16 bytes.
- Auxiliary Data attached to a version. Only load on-demand.