Objective Function

Definitions

1. The function a model or training process is trying to optimize, such as minimizing error or maximizing reward. The objective function strongly shapes what the system learns and how it behaves.

   In plain English: The mathematical target a model or training process tries to optimize.

   Example: "The team revisited the objective function after realizing the model was learning to maximize engagement signals that did not match product quality."

Related Terms

• distillation
• Expert Iteration
• Gradient-Free Optimization
• Inference Optimization
• Neural Network Pruning
• Next Token Prediction
• Noise Injection
• Preference Data
• Refusal Training
• Reward Engineering
• Reward Signal
• Score Function
• Self-Supervised
• Training Curriculum
• Training Distribution
• Training Dynamics
• Training Recipe