Module model

Source
Expand description

A safe wrapper around llama_model.

Modules§

params
A safe wrapper around llama_model_params.

Structs§

LlamaChatMessage
A Safe wrapper around llama_chat_message
LlamaLoraAdapter
A safe wrapper around llama_lora_adapter.
LlamaModel
A safe wrapper around llama_model.

Enums§

AddBos
How to determine if we should prepend a bos token to tokens
LlamaTokenTypeFromIntError
There was an error converting a llama_vocab_type to a VocabType.
Special
How to determine if we should tokenize special tokens
VocabType
a rusty equivalent of llama_vocab_type