rustc-ap-rustc_lexer-569.0.0
- rustc-ap-rustc_lexer 569.0.0
- Docs.rs crate page
- MIT / Apache-2.0
- Links
- Repository
- crates.io
- Source
- Owners
- alexcrichton
- Dependencies
- unicode-xid ^0.1.0 normal
- Versions
Go to latest version
Platform
Feature flags

Rust

☰

[−][src]Function rustc_lexer::tokenize

pub fn tokenize(input: &str) -> impl Iterator<Item = Token> + '_

Help

Keyboard Shortcuts

?: Show this help dialog
S: Focus the search field
↑: Move up in search results
↓: Move down in search results
↹: Switch tab
⏎: Go to active search result
+: Expand all sections
-: Collapse all sections

Search Tricks

Prefix searches with a type followed by a colon (e.g., fn:) to restrict the search to a given type.

Accepted types are: fn, mod, struct, enum, trait, type, macro, and const.

Search functions by type signature (e.g., vec -> usize or * -> vec)

Search multiple things at once by splitting your query with comma (e.g., str,u8 or String,struct:Vec,test)