Module llama_backend

Representation of an initialized llama backend

Structs

InvalidNumaStrategy

An invalid numa strategy was provided.

LlamaBackend

Representation of an initialized llama backend This is required as a parameter for most llama functions as the backend must be initialized before any llama functions are called. This type is proof of initialization.

Enums

NumaStrategy

A rusty wrapper around numa_strategy.