LLM Server

Definitions

1. A server that hosts or brokers access to one or more large language models for applications or internal users. LLM servers may perform model serving directly or act as controlled entry points to hosted providers.

   In plain English: A server used to host or access large language models.

   Example: "They kept experimental traffic on a separate LLM server so failures would not impact customer-facing workloads."

Related Terms

• AI Server
• LLM Cost
• LLM Output
• LLM Prompt
• LLM Provider
• LLM Request
• LLM Response
• LLM Service
• LLM Tool
• Model Server