Reward Signal

Definitions

1. The signal used to tell a learning system how good or bad an action, output, or trajectory was. Reward signals drive optimization, so poorly specified signals can produce unintended behavior.

   In plain English: The feedback signal that tells the system what behavior is good or bad.

   Example: "They changed the reward signal after realizing the agent was maximizing task completion counts by ignoring quality constraints."

Related Terms

• Next Token Prediction
• Noise Injection
• Objective Function
• Preference Data
• Refusal Training
• Reward Engineering
• Self-Supervised
• Training Curriculum
• Training Distribution
• Training Recipe