pub fn infer(
model: &InferencingModel,
prompt: &str,
params: Option<InferencingParams>,
) -> Result<InferencingResult, Error>
Expand description
Perform inferencing using the provided model and prompt with the given optional params
pub fn infer(
model: &InferencingModel,
prompt: &str,
params: Option<InferencingParams>,
) -> Result<InferencingResult, Error>
Perform inferencing using the provided model and prompt with the given optional params