Response Token
Noun · AI & Machine Learning
Definitions
A token generated in the response portion of a model call. Response tokens are often tracked separately from prompt tokens because they influence output length, latency, and cost differently.
In plain English: A token that belongs to the generated response.
Example: "They capped response token limits for the support bot so short factual answers stayed fast and cheap."