Sequence Length

Definitions

1. The number of tokens or elements in a sequence processed by a model. Sequence length affects memory use, compute cost, and how much context a system can handle at once.

   In plain English: How long a token sequence is.

   Example: "They had to reduce batch size as sequence length increased because memory usage rose sharply."

Related Terms

• AI API
• AI Memory
• Context Distillation
• Model Context
• Multi-Turn
• RAG Context
• Sequence Model
• Token Sequence