llama_cpp_2::context

Module params

Source
Expand description

A safe wrapper around llama_context_params.

Structs§

LlamaContextParams
A safe wrapper around llama_context_params.

Enums§

LlamaPoolingType
A rusty wrapper around LLAMA_POOLING_TYPE.
RopeScalingType
A rusty wrapper around rope_scaling_type.