Function spin_sdk::llm::infer_with_options
source · pub fn infer_with_options(
model: InferencingModel<'_>,
prompt: &str,
options: InferencingParams
) -> Result<InferencingResult, Error>
Expand description
Perform inferencing using the provided model, prompt, and options