tokenization
About 0.01 uses per million words.
Meaning
- noun The act or process of tokenizing.
- noun An instance created by that act or process: something tokenized.
This was an unlikely tokenization of the input string.
Similar words
tokening lexicalization zeroization assetization nominalization demonetization tagging iotization consonantalization iconization
Often followed by
of and is process in
Save “tokenization” to learn later