Struct Manager

pub struct Manager<const N: usize>(/* private fields */);

A shared LRU cache manager designed to manage a large volume of assets.

• Space optimized in-memory LRU (see pingora_lru).
• Instead of a single giant LRU, this struct shards the assets into N independent LRUs.

This allows EvictionManager::save() not to lock the entire cache manager while performing serialization.

Implementations

impl<const N: usize> Manager<N>

pub fn with_capacity(limit: usize, capacity: usize) -> Self

Create a Manager with the given size limit and estimated per shard capacity.

The capacity is for preallocating to avoid reallocation cost when the LRU grows.

pub fn serialize_shard(&self, shard: usize) -> Result<Vec<u8>>

Serialize the given shard

pub fn deserialize_shard(&self, buf: &[u8]) -> Result<()>

Deserialize a shard

Shard number is not needed because the key itself will hash to the correct shard.

Trait Implementations

impl<const N: usize> EvictionManager for Manager<N>

fn total_size(&self) -> usize

Total size of the cache in bytes tracked by this eviction manager

fn total_items(&self) -> usize

Number of assets tracked by this eviction manager

fn evicted_size(&self) -> usize

Number of bytes that are already evicted

fn evicted_items(&self) -> usize

Number of assets that are already evicted

fn admit( &self, item: CompactCacheKey, size: usize, _fresh_until: SystemTime, ) -> Vec<CompactCacheKey>

Admit an item

fn remove(&self, item: &CompactCacheKey)

Remove an item from the eviction manager.

fn access( &self, item: &CompactCacheKey, size: usize, _fresh_until: SystemTime, ) -> bool

Access an item that should already be in cache.

fn peek(&self, item: &CompactCacheKey) -> bool

Peek into the manager to see if the item is already tracked by the system

fn save<'life0, 'life1, 'async_trait>( &'life0 self, dir_path: &'life1 str, ) -> Pin<Box<dyn Future<Output = Result<()>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Serialize to save the state of this eviction manager to disk

fn load<'life0, 'life1, 'async_trait>( &'life0 self, dir_path: &'life1 str, ) -> Pin<Box<dyn Future<Output = Result<()>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

The counterpart of Self::save().