Internal Representation

Definitions

1. The hidden encoded form in which a model stores and transforms information while processing inputs. Internal representations are a major focus of interpretability research because they influence how models generalize and reason.

   In plain English: The hidden way a model internally encodes information.

   Example: "Researchers studied the model's internal representation of entities to understand why it confused similar product names."

Related Terms

• Context Extension
• Data Mixture
• Dense Model
• Frontier Model
• Large Context Model
• Likelihood
• Model Alignment
• Model Fingerprint
• Model Gateway
• Preference Model
• Representation
• Sparse Model
• Steering Vector
• Student Model
• Superposition
• Token ID