Deep Learning Glossary

Browse 1 deep learning terms defined in plain English, from the cultural dictionary of computing.

1 Deep Learning Terms

attention head

Attention Head is a single attention mechanism within a multi-head attention layer of a transformer neural network. In the transformer architecture (introduced...

Related Topics

• Transformers (1 terms in common)
• Ai (1 terms in common)