LLM Token

Definitions

1. A token as used in the context of large language models, counted toward prompt size, generation limits, and billing. LLM token usage is closely monitored because it affects both capability and cost.

   In plain English: A unit of text counted by a large language model.

   Example: "They shortened the default system prompt to cut average LLM token usage across millions of requests."

Related Terms

• Context Window Limit
• AI Token
• Input Token
• LLM Benchmark
• LLM Cache
• LLM Calling
• LLM Completion
• LLM Config
• LLM Memory
• Max Tokens
• Model Token
• Prompt Token
• Response Token
• Token Count
• Token Generation
• Token ID
• Token Prediction
• Token Probability
• Token Sequence