AI Gateway
Noun · AI & Machine Learning
Definitions
A gateway layer that routes, authenticates, observes, and controls access to one or more AI providers or internal AI services. AI gateways often handle rate limits, retries, logging, policy checks, and model selection in one place.
In plain English: A central gateway that manages access to AI services.
Example: "They put an AI gateway in front of all model calls so quota rules and prompt logging stayed consistent across teams."