Struct spin_sdk::llm::InferencingUsage
source · #[repr(C)]pub struct InferencingUsage {
pub prompt_token_count: u32,
pub generated_token_count: u32,
}
Expand description
Usage information related to the inferencing result
Fields§
§prompt_token_count: u32
Number of tokens in the prompt
generated_token_count: u32
Number of tokens generated by the inferencing operation
Trait Implementations§
source§impl Clone for InferencingUsage
impl Clone for InferencingUsage
source§fn clone(&self) -> InferencingUsage
fn clone(&self) -> InferencingUsage
Returns a copy of the value. Read more
1.0.0 · source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source
. Read moresource§impl Debug for InferencingUsage
impl Debug for InferencingUsage
impl Copy for InferencingUsage
Auto Trait Implementations§
impl RefUnwindSafe for InferencingUsage
impl Send for InferencingUsage
impl Sync for InferencingUsage
impl Unpin for InferencingUsage
impl UnwindSafe for InferencingUsage
Blanket Implementations§
source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more