spin_sdk::llm

Function infer

Source 
pub fn infer(
    model: InferencingModel<'_>,
    prompt: &str,
) -> Result<InferencingResult, Error>
Expand description

Perform inferencing using the provided model and prompt