Prompt Token

Definitions

1. A token consumed by the prompt portion of a model request, including system instructions, examples, user content, and retrieved context. Prompt token counts matter because they affect cost and leave less room for the response.

   In plain English: A token that belongs to the prompt side of a model request.

   Example: "The retrieval layer was limited because prompt token growth had become the biggest driver of cost."

Related Terms

• AI Template
• AI Token
• Input Token
• LLM Token
• Max Tokens
• Model Token
• Prefix
• Prompt Cache
• Response Token
• Token Prediction
• Token Sequence