Vocabulary Size
Noun · AI & Machine Learning
Definitions
The number of unique tokens available in a model's vocabulary. Vocabulary size affects tokenization efficiency, memory usage, and how text in different languages or domains is represented.
In plain English: The number of unique tokens in a model's vocabulary.
Example: "They compared vocabulary size across tokenizers because dense tokenization was making multilingual prompts unnecessarily expensive."