Decoder Only

Definitions

1. Describing a transformer architecture that uses only the decoder-style stack, typically generating tokens autoregressively from left to right. Many modern large language models are decoder-only models.

   In plain English: A model architecture that generates output using only the decoder side of a transformer.

   Example: "They chose a decoder-only architecture for the prototype because the task centered on fluent next-token generation."

Related Terms

• attention head
• AI Multi-Agent
• Alignment Tax
• Benchmark Saturation
• Capability Overhang
• Chain of Density
• Chain of Verification
• Chinese Room