Struct LanceIndexStore

pub struct LanceIndexStore { /* private fields */ }

An index store that serializes scalar indices using the lance format

Scalar indices are made up of named collections of record batches. This struct relies on there being a dedicated directory for the index and stores each collection in a file in the lance format.

Implementations

impl LanceIndexStore

pub fn new( object_store: ObjectStore, index_dir: Path, metadata_cache: FileMetadataCache, ) -> Self

Create a new index store at the given directory

pub fn with_legacy_format(self, use_legacy_format: bool) -> Self

Trait Implementations

impl Debug for LanceIndexStore

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl DeepSizeOf for LanceIndexStore

fn deep_size_of_children(&self, context: &mut Context) -> usize

Returns an estimation of the heap-managed storage of this object. This does not include the size of the object itself.

fn deep_size_of(&self) -> usize

Returns an estimation of a total size of memory owned by the object, including heap-managed storage.

impl IndexStore for LanceIndexStore

fn as_any(&self) -> &dyn Any

fn io_parallelism(&self) -> usize

Suggested I/O parallelism for the store

fn new_index_file<'life0, 'life1, 'async_trait>( &'life0 self, name: &'life1 str, schema: Arc<Schema>, ) -> Pin<Box<dyn Future<Output = Result<Box<dyn IndexWriter>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Create a new file and return a writer to store data in the file

fn open_index_file<'life0, 'life1, 'async_trait>( &'life0 self, name: &'life1 str, ) -> Pin<Box<dyn Future<Output = Result<Arc<dyn IndexReader>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Open an existing file for retrieval

fn copy_index_file<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, name: &'life1 str, dest_store: &'life2 dyn IndexStore, ) -> Pin<Box<dyn Future<Output = Result<()>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Copy a range of batches from an index file from this store to another