Preferences Glossary
Browse 4 preferences terms defined in plain English, from the cultural dictionary of computing.
4 Preferences Terms
- Direct Preference Optimization
- A post-training method that updates a model directly from paired preference data without an explicit reward model. It influences how models are trained,...
- Human Preference
- Human judgments about which outputs, behaviors, or policies are more desirable, useful, or acceptable in a given context. Human preference data is often used...
- Preference Data
- Data capturing which outputs humans prefer among alternatives, often used to train ranking models, reward models, or alignment systems. Preference data is...
- Preference Model
- A model trained to predict or score human preferences among candidate outputs, often used in alignment and reinforcement learning pipelines. Preference models...
Related Topics
- Ai (3 terms in common)
- Alignment (2 terms in common)
- Training (1 terms in common)
- Models (1 terms in common)
- Optimization (1 terms in common)