elasticlunr::lang

Function tokenize_whitespace

Source
pub fn tokenize_whitespace(text: &str) -> Vec<String>
Expand description

Splits a text string into a vector of individual tokens.