LLM Cost

Definitions

1. The cost associated with using a large language model, including API charges, compute resources, and surrounding operational overhead. LLM cost is closely watched in production because prompt size and traffic can scale quickly.

   In plain English: The cost of using a large language model.

   Example: "They cut LLM cost by caching retrieval-heavy answers and using a smaller model for simple routing decisions."

Related Terms

• AI Cost
• LLM Output
• LLM Prompt
• LLM Provider
• LLM Request
• LLM Response
• LLM Server
• LLM Service
• LLM Tool
• LLM Workflow
• Model Cost
• Training Cost