LLM Request

Noun · AI & Machine Learning

Definitions

  1. A request made to a large language model, including the prompt, context, settings, and any tools or metadata attached to the call. Tracking LLM requests carefully is important for debugging cost and behavior changes.

    In plain English: A single call made to a large language model.

    Example: "The middleware tagged each LLM request with a feature name so cost spikes could be traced back to the responsible workflow."

Related Terms