Enum rustc_ap_rustc_lexer::TokenKind[−][src]

pub enum TokenKind {

Show variants    LineComment {
        doc_style: Option<DocStyle>,
    },
    BlockComment {
        doc_style: Option<DocStyle>,
        terminated: bool,
    },
    Whitespace,
    Ident,
    RawIdent,
    Literal {
        kind: LiteralKind,
        suffix_start: usize,
    },
    Lifetime {
        starts_with_number: bool,
    },
    Semi,
    Comma,
    Dot,
    OpenParen,
    CloseParen,
    OpenBrace,
    CloseBrace,
    OpenBracket,
    CloseBracket,
    At,
    Pound,
    Tilde,
    Question,
    Colon,
    Dollar,
    Eq,
    Bang,
    Lt,
    Gt,
    Minus,
    And,
    Or,
    Plus,
    Star,
    Slash,
    Caret,
    Percent,
    Unknown,

}
Expand description

Enum representing common lexeme types.

Variants

LineComment

“// comment”

Show fields

Fields of LineComment

doc_style: Option<DocStyle>
BlockComment

/* block comment */

Block comments can be recursive, so the sequence like /* /* */ will not be considered terminated and will result in a parsing error.

Show fields

Fields of BlockComment

doc_style: Option<DocStyle>terminated: bool
Whitespace

Any whitespace characters sequence.

Ident

“ident” or “continue” At this step keywords are also considered identifiers.

RawIdent

“r#ident”

Literal

“12_u8”, “1.0e-40”, “b“123”“. See LiteralKind for more details.

Show fields

Fields of Literal

kind: LiteralKindsuffix_start: usize
Lifetime

“’a”

Show fields

Fields of Lifetime

starts_with_number: bool
Semi

“;”

Comma

“,”

Dot

“.”

OpenParen

“(”

CloseParen

“)”

OpenBrace

“{”

CloseBrace

“}”

OpenBracket

“[”

CloseBracket

“]”

At

“@”

Pound

“#”

Tilde

“~”

Question

“?”

Colon

“:”

Dollar

“$”

Eq

“=”

Bang

“!”

Lt

“<”

Gt

“>”

Minus

“-”

And

“&”

Or

“|”

Plus

“+”

Star

“*”

Slash

“/”

Caret

“^”

Percent

“%”

Unknown

Unknown token, not expected by the lexer, e.g. “№”

Trait Implementations

impl Clone for TokenKind[src]

fn clone(&self) -> TokenKind[src]

Returns a copy of the value. Read more

fn clone_from(&mut self, source: &Self)1.0.0[src]

Performs copy-assignment from source. Read more

impl Debug for TokenKind[src]

fn fmt(&self, f: &mut Formatter<'_>) -> Result[src]

Formats the value using the given formatter. Read more

impl Ord for TokenKind[src]

fn cmp(&self, other: &TokenKind) -> Ordering[src]

This method returns an Ordering between self and other. Read more

#[must_use]
fn max(self, other: Self) -> Self1.21.0[src]

Compares and returns the maximum of two values. Read more

#[must_use]
fn min(self, other: Self) -> Self1.21.0[src]

Compares and returns the minimum of two values. Read more

#[must_use]
fn clamp(self, min: Self, max: Self) -> Self1.50.0[src]

Restrict a value to a certain interval. Read more

impl PartialEq<TokenKind> for TokenKind[src]

fn eq(&self, other: &TokenKind) -> bool[src]

This method tests for self and other values to be equal, and is used by ==. Read more

fn ne(&self, other: &TokenKind) -> bool[src]

This method tests for !=.

impl PartialOrd<TokenKind> for TokenKind[src]

fn partial_cmp(&self, other: &TokenKind) -> Option<Ordering>[src]

This method returns an ordering between self and other values if one exists. Read more

#[must_use]
fn lt(&self, other: &Rhs) -> bool1.0.0[src]

This method tests less than (for self and other) and is used by the < operator. Read more

#[must_use]
fn le(&self, other: &Rhs) -> bool1.0.0[src]

This method tests less than or equal to (for self and other) and is used by the <= operator. Read more

#[must_use]
fn gt(&self, other: &Rhs) -> bool1.0.0[src]

This method tests greater than (for self and other) and is used by the > operator. Read more

#[must_use]
fn ge(&self, other: &Rhs) -> bool1.0.0[src]

This method tests greater than or equal to (for self and other) and is used by the >= operator. Read more

impl Copy for TokenKind[src]

impl Eq for TokenKind[src]

impl StructuralEq for TokenKind[src]

impl StructuralPartialEq for TokenKind[src]

Auto Trait Implementations

Blanket Implementations

impl<T> Any for T where
    T: 'static + ?Sized, [src]

pub fn type_id(&self) -> TypeId[src]

Gets the TypeId of self. Read more

impl<T> Borrow<T> for T where
    T: ?Sized, [src]

pub fn borrow(&self) -> &T[src]

Immutably borrows from an owned value. Read more

impl<T> BorrowMut<T> for T where
    T: ?Sized, [src]

pub fn borrow_mut(&mut self) -> &mut T[src]

Mutably borrows from an owned value. Read more

impl<T> From<T> for T[src]

pub fn from(t: T) -> T[src]

Performs the conversion.

impl<T, U> Into<U> for T where
    U: From<T>, [src]

pub fn into(self) -> U[src]

Performs the conversion.

impl<T> ToOwned for T where
    T: Clone, [src]

type Owned = T

The resulting type after obtaining ownership.

pub fn to_owned(&self) -> T[src]

Creates owned data from borrowed data, usually by cloning. Read more

pub fn clone_into(&self, target: &mut T)[src]

🔬 This is a nightly-only experimental API. (toowned_clone_into)

recently added

Uses borrowed data to replace owned data, usually by cloning. Read more

impl<T, U> TryFrom<U> for T where
    U: Into<T>, [src]

type Error = Infallible

The type returned in the event of a conversion error.

pub fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>[src]

Performs the conversion.

impl<T, U> TryInto<U> for T where
    U: TryFrom<T>, [src]

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.

pub fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>[src]

Performs the conversion.