Token Count

Noun · AI & Machine Learning

Definitions

  1. The number of tokens present in a prompt, response, document, or full model interaction. Token count affects cost, latency, and whether a request fits within model limits.

    In plain English: The number of tokens in some AI-related text or interaction.

    Example: "The team watched token count closely because retrieved policy snippets were quietly doubling prompt size."

Related Terms