Expand description
SQL Tokenizer
The tokenizer (a.k.a. lexer) converts a string into a sequence of tokens.
The tokens then form the input for the parser, which outputs an Abstract Syntax Tree (AST).
Re-exports
pub use crate::location::Location;Structs
SQL Tokenizer
Tokenizer error
A keyword (like SELECT) or an optionally quoted SQL identifier
Enums
SQL Token enumeration