Function elasticlunr::lang::tokenize_whitespace
source · pub fn tokenize_whitespace(text: &str) -> Vec<String> ⓘ
Expand description
Splits a text string into a vector of individual tokens.
pub fn tokenize_whitespace(text: &str) -> Vec<String> ⓘ
Splits a text string into a vector of individual tokens.