Transformer Glossary
Browse 3 transformer terms defined in plain English, from the cultural dictionary of computing.
3 Transformer Terms
- Attention
- The core mechanism of transformer models that allows each token to dynamically attend to (weigh the importance of) every other token in the sequence....
- Attention Mechanism
- Attention Mechanism is a component in neural networks that allows a model to dynamically focus on the most relevant parts of its input when producing each...
- Large Language Model
- A neural network with billions of parameters trained on massive text datasets to understand and generate human language. GPT, Claude, Llama, and Gemini are...
Related Topics
- Architecture (2 terms in common)
- Nlp (2 terms in common)
- Foundational (1 terms in common)
- Foundation Model (1 terms in common)