AI Server
Noun · AI & Machine Learning
Definitions
A server or service instance that hosts AI workloads such as inference, retrieval, or orchestration. AI servers may need specialized hardware, caching, and queueing strategies compared with ordinary web servers.
In plain English: A server that runs AI-related workloads.
Example: "They split embeddings onto a separate AI server so chat latency would not spike during large indexing jobs."