llm_chain

Module options

Source

Structs§

ModelRef
A reference to a model name or path Useful for
Options
A collection of options that can be used to configure a model. Options is the struct that represents a set of options for a large language model. It provides methods for creating, adding, and retrieving options.
OptionsBuilder
OptionsBuilder is a helper structure used to construct Options in a flexible way.
OptionsCascade
A cascade of option sets.
TokenBias
A list of tokens to bias during the process of inferencing.

Enums§

Opt
OptDiscriminants
Auto-generated discriminant enum variants

Functions§

options_from_env
Loads options from environment variables. Every option that can be easily understood from a string is avaliable the name of the option will be in upper snake case, that means that the option Opt::ApiKey has the environment variable LLM_CHAIN_API_KEY