Structs§
Constants§
- kCFString
Tokenizer Attribute Language - kCFString
Tokenizer Attribute Latin Transcription - kCFString
Tokenizer Token HasDerived SubTokens Mask - kCFString
Tokenizer Token HasHas Numbers Mask - kCFString
Tokenizer Token HasNon Letters Mask - kCFString
Tokenizer Token HasSub Tokens Mask - kCFString
Tokenizer Token IsCJ Word Mask - kCFString
Tokenizer Token None - kCFString
Tokenizer Token Normal - kCFString
Tokenizer Unit Line Break - kCFString
Tokenizer Unit Paragraph - kCFString
Tokenizer Unit Sentence - kCFString
Tokenizer Unit Word - kCFString
Tokenizer Unit Word Boundary
Functions§
- CFString
Tokenizer ⚠Advance ToNext Token - CFString
Tokenizer ⚠Copy Best String Language - CFString
Tokenizer ⚠Copy Current Token Attribute - CFString
Tokenizer ⚠Create - CFString
Tokenizer ⚠GetCurrent SubTokens - CFString
Tokenizer ⚠GetCurrent Token Range - CFString
Tokenizer ⚠GetTypeID - CFString
Tokenizer ⚠GoTo Token AtIndex - CFString
Tokenizer ⚠SetString