tokenization

词形变化

tokenizations 复数 tokenizations

别名

tokenisation

释义与例句

n.
  1. 1.

    The act or process of tokenizing.

    可数 不可数
  2. 2.

    Something tokenized.

    可数 不可数

    This was an unlikely tokenization of the input string.

词源

From token + -ization.

来源：wiktionary