Module kv_cache

utilities for working with the kv cache

Structs

KVCacheView

An updateable view of the KV cache. (use only for debugging purposes)

KVCacheViewCell

Information associated with an individual cell in the KV cache view.

Enums

KvCacheConversionError

Errors that can occur when attempting to prepare values for the kv cache