Docs.rs
brack-tokenizer-0.1.0
brack-tokenizer 0.1.0
Docs.rs crate page
MIT OR Apache-2.0
Links
crates.io
Source
Owners
momeemt
Dependencies
anyhow ^1.0.79
normal
unicode-segmentation ^1.10
normal
Versions
0%
of the crate is documented
Platform
i686-pc-windows-msvc
i686-unknown-linux-gnu
x86_64-apple-darwin
x86_64-pc-windows-msvc
x86_64-unknown-linux-gnu
Feature flags
Rust
About docs.rs
Privacy policy
Rust website
The Book
Standard Library API Reference
Rust by Example
The Cargo Guide
Clippy Documentation
brack_
tokenizer
0.1.0
In brack_
tokenizer::
tokenize
brack_tokenizer
::
tokenize
Function
tokenize
Copy item path
Source
pub fn tokenize<P:
AsRef
<
Path
>>(path: P) ->
Result
<
Vec
<
Token
>>