Student Model

Definitions

1. A smaller or simpler model trained to imitate or approximate the behavior of a larger teacher model. Student models are often used to reduce cost and latency while preserving as much quality as possible.

   In plain English: A smaller model trained to learn from a larger one.

   Example: "They trained a student model on the teacher's outputs so the mobile app could keep most of the quality without needing cloud-scale inference."

Related Terms

• Context Extension
• Data Mixture
• Dense Model
• Frontier Model
• Internal Representation
• Large Context Model
• Likelihood
• Model Alignment