Max Tokens

Definitions

1. A setting that limits how many tokens a model may generate in a response or, in some systems, how large parts of the request can be. Max token settings help manage cost, latency, and output length.

   In plain English: A limit on how many tokens an AI response is allowed to use.

   Example: "They lowered max tokens for the chat endpoint because most support answers needed one paragraph, not a full essay."

Related Terms

• AI Token
• Input Token
• LLM Config
• LLM Token
• Model Config
• Model Token
• Prompt Token
• Response Token
• Token Count
• Token Generation
• Token Prediction
• Token Sequence
• Training Config