retokenize

From Wiktionary, the free dictionary
Jump to navigation Jump to search

English[edit]

Etymology[edit]

re- +‎ tokenize

Pronunciation[edit]

Verb[edit]

retokenize (third-person singular simple present retokenizes, present participle retokenizing, simple past and past participle retokenized)

  1. (transitive, computing) To tokenize again.