spin_sdk::llm::llm

Function infer

Source
pub fn infer(
    model: &InferencingModel,
    prompt: &str,
    params: Option<InferencingParams>,
) -> Result<InferencingResult, Error>
Expand description

Perform inferencing using the provided model and prompt with the given optional params