Data Mixture

Definitions

1. The composition and relative proportions of different datasets or data sources used to train a model. The data mixture can strongly influence what capabilities the model develops and where it performs poorly.

   In plain English: The blend of different data sources used to train a model.

   Example: "They adjusted the data mixture to include more technical support transcripts because the model sounded polished but lacked operational accuracy."

Related Terms

• Context Extension
• Dense Model
• Frontier Model
• Internal Representation
• Large Context Model
• Likelihood
• Model Alignment
• Model Fingerprint
• Model Gateway
• Preference Model
• Sparse Model
• Student Model
• Training Data Curation
• Training Dataset