Prompt Compression

Definitions

1. The practice of reducing prompt length while preserving the instructions or context needed for good performance. Prompt compression helps with latency, cost, and context-window limits, especially in large-scale systems.

   In plain English: Shortening a prompt while keeping the important information intact.

   Example: "The team used prompt compression to fit more retrieval context into the same request budget without losing crucial guardrails."

Related Terms

• Instruction Hierarchy
• Linearized Attention
• Parameter Efficient
• Parameter Sharing
• Prompt Attack
• Prompt Guard
• Prompt Registry
• Sparse Model
• Token Merging
• Window Attention