Model Server
Noun · AI & Machine Learning
Definitions
A server or service instance that loads a model and handles inference requests against it. Model servers may support batching, scaling, caching, and health management for production deployments.
In plain English: A server that loads and runs a model.
Example: "They isolated the image model server so heavy visual traffic would not degrade text response times."