retokenize

From Wiktionary, the free dictionary
Jump to navigation Jump to search

English

[edit]

Etymology

[edit]

From re- +‎ tokenize.

Pronunciation

[edit]

Verb

[edit]

retokenize (third-person singular simple present retokenizes, present participle retokenizing, simple past and past participle retokenized)

  1. (transitive, computing) To tokenize again.