llama_cpp_2::model

Module params

Source
Expand description

A safe wrapper around llama_model_params.

Modules§

kv_overrides
Key-value overrides for a model.

Structs§

LlamaModelParams
A safe wrapper around llama_model_params.