LLM Optimization

Noun · AI & Machine Learning

Definitions

  1. Improving a large language model workflow for quality, speed, reliability, or cost through changes to prompts, routing, context management, evaluation, or infrastructure. LLM optimization is often iterative and workload-specific.

    In plain English: Improving how a large language model system performs.

    Example: "The biggest LLM optimization win came from rewriting the system prompt to remove duplicated instructions."

Related Terms