llm_chain_llama_sys

Function llama_sample_frequency_and_presence_penalties

Source
pub unsafe extern "C" fn llama_sample_frequency_and_presence_penalties(
    ctx: *mut llama_context,
    candidates: *mut llama_token_data_array,
    last_tokens: *const llama_token,
    last_tokens_size: usize,
    alpha_frequency: f32,
    alpha_presence: f32,
)
Expand description

@details Frequency and presence penalties described in OpenAI API https://platform.openai.com/docs/api-reference/parameter-details.