Module solana_runtime::snapshot_utils

Structs

• BankFromArchiveTimings
• BankFromDirTimings
• BankSnapshotInfo
  Information about a bank snapshot. Namely the slot of the bank, the path to the snapshot, and the type of the snapshot.

Enums

• ArchiveFormat
  The different archive formats used for snapshots
• BankSnapshotType
  Bank snapshots traditionally had their accounts hash calculated prior to serialization. Since the hash calculation takes a long time, an optimization has been put in to offload the accounts hash calculation. The bank serialization format has not changed, so we need another way to identify if a bank snapshot contains the calculated accounts hash or not.
• ParseError
• SnapshotError
• SnapshotFrom
  When constructing a bank a snapshot, traditionally the snapshot was from a snapshot archive. Now, the snapshot can be from a snapshot directory, or from a snapshot archive. This is the flag to indicate which.
• SnapshotNewFromDirError
• SnapshotVersion
• VerifyBank
  allow tests to specify what happened to the serialized format
• VerifySlotDeltasError
  Errors that can happen in verify_slot_deltas()

Constants

• BANK_SNAPSHOT_PRE_FILENAME_EXTENSION
• DEFAULT_ARCHIVE_COMPRESSION
• DEFAULT_FULL_SNAPSHOT_ARCHIVE_INTERVAL_SLOTS
• DEFAULT_INCREMENTAL_SNAPSHOT_ARCHIVE_INTERVAL_SLOTS
• DEFAULT_MAX_FULL_SNAPSHOT_ARCHIVES_TO_RETAIN
• DEFAULT_MAX_INCREMENTAL_SNAPSHOT_ARCHIVES_TO_RETAIN
• FULL_SNAPSHOT_ARCHIVE_FILENAME_REGEX
• INCREMENTAL_SNAPSHOT_ARCHIVE_FILENAME_REGEX
• SNAPSHOT_ACCOUNTS_HARDLINKS
• SNAPSHOT_ARCHIVE_DOWNLOAD_DIR
• SNAPSHOT_STATE_COMPLETE_FILENAME
• SNAPSHOT_STATUS_CACHE_FILENAME
• SNAPSHOT_VERSION_FILENAME
• SUPPORTED_ARCHIVE_COMPRESSION
• TAR_BZIP2_EXTENSION
• TAR_EXTENSION
• TAR_GZIP_EXTENSION
• TAR_LZ4_EXTENSION
• TAR_ZSTD_EXTENSION
• TMP_SNAPSHOT_ARCHIVE_PREFIX

Functions

• add_bank_snapshot
  Serialize a bank to a snapshot
• archive_snapshot_package
  Make a snapshot archive out of the snapshot package
• bank_fields_from_snapshot_archives
  Utility for parsing out bank specific information from a snapshot archive. This utility can be used to parse out bank specific information like the leader schedule, epoch schedule, etc.
• bank_from_latest_snapshot_archives
  Rebuild bank from snapshot archives. This function searches full_snapshot_archives_dir and incremental_snapshot_archives_dir for the highest full snapshot and highest corresponding incremental snapshot, then rebuilds the bank.
• bank_from_latest_snapshot_dir
  follow the prototype of fn bank_from_latest_snapshot_archives, implement the from_dir case
• bank_from_snapshot_archives
  Rebuild bank from snapshot archives. Handles either just a full snapshot, or both a full snapshot and an incremental snapshot.
• bank_from_snapshot_dir
  Build bank from a snapshot (a snapshot directory, not a snapshot archive)
• bank_to_full_snapshot_archive
  Convenience function to create a full snapshot archive out of any Bank, regardless of state. The Bank will be frozen during the process. This is only called from ledger-tool or tests. Warping is a special case as well.
• bank_to_incremental_snapshot_archive
  Convenience function to create an incremental snapshot archive out of any Bank, regardless of state. The Bank will be frozen during the process. This is only called from ledger-tool or tests. Warping is a special case as well.
• build_full_snapshot_archive_path
  Build the full snapshot archive path from its components: the snapshot archives directory, the snapshot slot, the accounts hash, and the archive format.
• build_incremental_snapshot_archive_path
  Build the incremental snapshot archive path from its components: the snapshot archives directory, the snapshot base slot, the snapshot slot, the accounts hash, and the archive format.
• build_snapshot_archives_remote_dir
• clean_orphaned_account_snapshot_dirs
  The account snapshot directories under <account_path>/snapshot/ contain account files hardlinked from <account_path>/run taken at snapshot time. They are referenced by the symlinks from the bank snapshot dir snapshot//accounts_hardlinks/. We observed that sometimes the bank snapshot dir could be deleted but the account snapshot directories were left behind, possibly by some manual operations or some legacy code not using the symlinks to clean up the acccount snapshot hardlink directories. This function cleans up any account snapshot directories that are no longer referenced by the bank snapshot dirs, to ensure proper snapshot operations.
• create_accounts_run_and_snapshot_dirs
  To allow generating a bank snapshot directory with full state information, we need to hardlink account appendvec files from the runtime operation directory to a snapshot hardlink directory. This is to create the run/ and snapshot sub directories for an account_path provided by the user. These two sub directories are on the same file system partition to allow hard-linking.
• create_all_accounts_run_and_snapshot_dirs
  For all account_paths, create the run/ and snapshot/ sub directories. If an account_path directory does not exist, create it. It returns (account_run_paths, account_snapshot_paths) or error
• create_snapshot_dirs_for_tests
• create_tmp_accounts_dir_for_tests
• deserialize_snapshot_data_file
• get_bank_snapshot_dir
  Constructs the path to the bank snapshot directory for slot within bank_snapshots_dir
• get_bank_snapshots
  Get the bank snapshots in a directory
• get_bank_snapshots_post
  Get the bank snapshots in a directory
• get_bank_snapshots_pre
  Get the bank snapshots in a directory
• get_full_snapshot_archives
  Get a list of the full snapshot archives from a directory
• get_highest_bank_snapshot
  Get the bank snapshot with the highest slot in a directory
• get_highest_bank_snapshot_post
  Get the bank snapshot with the highest slot in a directory
• get_highest_bank_snapshot_pre
  Get the bank snapshot with the highest slot in a directory
• get_highest_full_snapshot_archive_info
  Get the path (and metadata) for the full snapshot archive with the highest slot in a directory
• get_highest_full_snapshot_archive_slot
  Get the highest slot of the full snapshot archives in a directory
• get_highest_incremental_snapshot_archive_info
  Get the path for the incremental snapshot archive with the highest slot, for a given full snapshot slot, in a directory
• get_highest_incremental_snapshot_archive_slot
  Get the highest slot of the incremental snapshot archives in a directory, for a given full snapshot slot
• get_incremental_snapshot_archives
  Get a list of the incremental snapshot archives from a directory
• get_snapshot_file_name
  Returns the file name of the bank snapshot for slot
• get_snapshot_storages
  Get the snapshot storages for this bank
• move_and_async_delete_path
  Delete directories/files asynchronously to avoid blocking on it. First, in sync context, rename the original path to *_deleted, then spawn a thread to delete the renamed path. If the process is killed and the deleting process is not done, the leftover path will be deleted in the next process life, so there is no file space leaking.
• move_and_async_delete_path_contents
  Moves and asynchronously deletes the contents of a directory to avoid blocking on it. The directory is re-created after the move, and should now be empty.
• package_and_archive_full_snapshot
  Helper function to hold shared code to package, process, and archive full snapshots
• package_and_archive_incremental_snapshot
  Helper function to hold shared code to package, process, and archive incremental snapshots
• path_to_file_name_str
  Get the &str from a &Path
• purge_bank_snapshots_older_than_slot
  Purges bank snapshots that are older than slot
• purge_incomplete_bank_snapshots
  Purges incomplete bank snapshots
• purge_old_bank_snapshots
  Purges bank snapshots, retaining the newest num_bank_snapshots_to_retain
• purge_old_bank_snapshots_at_startup
  At startup, purge old (i.e. unusable) bank snapshots
• purge_old_snapshot_archives
• remove_tmp_snapshot_archives
  If the validator halts in the middle of archive_snapshot_package(), the temporary staging directory won’t be cleaned up. Call this function to clean them up.
• serialize_snapshot_data_file
• should_take_full_snapshot
• should_take_incremental_snapshot
• verify_snapshot_archive
• write_snapshot_version_file
  Write the snapshot version as a file into the bank snapshot directory

Type Definitions

• Result