LLM Router

Definitions

1. A routing component that decides which large language model should handle a request based on task type, cost, latency, policy, or capacity. LLM routers help teams avoid using one model for every workload indiscriminately.

   In plain English: A system that chooses which large language model should handle a request.

   Example: "The LLM router sent schema extraction to a cheap deterministic model and routed complex drafting to a stronger one."

Related Terms

• AI Router
• LLM Benchmark
• LLM Cache
• LLM Calling
• LLM Completion
• LLM Config
• LLM Memory
• LLM Optimization
• LLM Pipeline
• Tool Selection