Thinking Token
Noun · AI & Machine Learning
Definitions
A token associated with intermediate reasoning or extended deliberation in a model's generation process. The term is often used when discussing tradeoffs between more deliberate reasoning and higher latency or cost.
In plain English: A token used as part of the model's extended reasoning process.
Example: "They limited thinking token budgets on routine tasks because extra deliberation did not improve simple account lookup answers."