Likelihood

Definitions

1. A probabilistic measure of how well a model assigns probability to observed data or candidate outputs. In AI and machine learning, likelihood is central to training objectives, scoring, and comparing hypotheses.

   In plain English: A measure of how probable a model thinks some data or output is.

   Example: "The decoder chose the higher-likelihood continuation even though a lower-probability alternative would have been more interesting stylistically."

Related Terms

• CPT
• Hidden Markov Model
• Context Extension
• Data Mixture
• Dense Model
• Frontier Model
• Internal Representation
• Large Context Model
• Logprob
• Model Alignment
• Model Fingerprint
• Model Gateway
• Preference Model
• Sparse Model
• Student Model
• Token Probability