tokenizers::utils::parallelism

Function is_parallelism_configured

Source
pub fn is_parallelism_configured() -> bool
Expand description

Check if the TOKENIZERS_PARALLELISM env variable has been explicitly set