Enum TokenizerType

#[repr(i32)]
pub enum TokenizerType {
    Unknown = 0,
    Prefix = 1,
    Whitespace = 2,
    Word = 3,
    Multilingual = 4,
}

Variants

Unknown = 0

Prefix = 1

Whitespace = 2

Word = 3

Multilingual = 4

Implementations

impl TokenizerType

pub fn is_valid(value: i32) -> bool

Returns true if value is a variant of TokenizerType.

pub fn from_i32(value: i32) -> Option<TokenizerType>

👎Deprecated: Use the TryFrom<i32> implementation instead

Converts an i32 to a TokenizerType, or None if value is not a valid variant.

impl TokenizerType

pub fn as_str_name(&self) -> &'static str

String value of the enum field names used in the ProtoBuf definition.

The values are not transformed in any way and thus are considered stable (if the ProtoBuf definition does not change) and safe for programmatic use.

pub fn from_str_name(value: &str) -> Option<Self>

Creates an enum from field names used in the ProtoBuf definition.

Trait Implementations

impl Clone for TokenizerType

fn clone(&self) -> TokenizerType

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenizerType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for TokenizerType

fn default() -> TokenizerType

Returns the “default value” for a type.

impl From<TokenizerType> for i32

fn from(value: TokenizerType) -> i32

Converts to this type from the input type.

impl Hash for TokenizerType

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl Ord for TokenizerType

fn cmp(&self, other: &TokenizerType) -> Ordering

This method returns an Ordering between self and other.

fn max(self, other: Self) -> Self

where Self: Sized,

Compares and returns the maximum of two values.

fn min(self, other: Self) -> Self

where Self: Sized,

Compares and returns the minimum of two values.

fn clamp(self, min: Self, max: Self) -> Self

where Self: Sized,

Restrict a value to a certain interval.

impl PartialEq for TokenizerType

fn eq(&self, other: &TokenizerType) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl PartialOrd for TokenizerType

fn partial_cmp(&self, other: &TokenizerType) -> Option<Ordering>

This method returns an ordering between self and other values if one exists.

fn lt(&self, other: &Rhs) -> bool

Tests less than (for self and other) and is used by the < operator.

fn le(&self, other: &Rhs) -> bool

Tests less than or equal to (for self and other) and is used by the <= operator.

fn gt(&self, other: &Rhs) -> bool

Tests greater than (for self and other) and is used by the > operator.

fn ge(&self, other: &Rhs) -> bool

Tests greater than or equal to (for self and other) and is used by the >= operator.

impl TryFrom<i32> for TokenizerType

type Error = UnknownEnumValue

The type returned in the event of a conversion error.

fn try_from(value: i32) -> Result<TokenizerType, UnknownEnumValue>

Performs the conversion.

impl Copy for TokenizerType

impl Eq for TokenizerType

impl StructuralPartialEq for TokenizerType