Token Probability
Noun · AI & Machine Learning
Definitions
The probability a model assigns to a particular token as the next output in a given context. Token probabilities are useful for scoring, confidence analysis, and understanding why certain outputs were chosen.
In plain English: How likely the model thinks a particular next token is.
Example: "They inspected token probability values to understand why the model consistently preferred one legal term over a synonym."