Home / Dictionary / Tokenize

Tokenize Uncommon

Definition, synonyms and related words

Definitions
Verb
1

To reduce to a set of tokens by lexical analysis.

See Also
tokenization tokenizing untokenized minority parse tokenizes retokenize token
Related Terms
Rhyming Words
ize wize pize cize size odize seize brize frize prize maize smize baize sufize pdfize resize upsize m size denize balize
Compare
Tokenize vs