msiz_rustc-ap-rustc_lexer-3.0.0
- msiz_rustc-ap-rustc_lexer 3.0.0
- Docs.rs crate page
- MIT / Apache-2.0
- Links
- Repository
- crates.io
- Source
- Owners
- msizanoen
- Dependencies
- unicode-xid ^0.2.0 normal
- Versions
- 7.83% of the crate is documented
Platform
Feature flags

Rust

msiz_rustc_ap_rustc_lexer3.0.0

msiz_rustc_ap_rustc_lexer

Function tokenize

pub fn tokenize(input: &str) -> impl Iterator<Item = Token> + '_