Pretraining Glossary

Browse 1 pretraining terms defined in plain English, from the cultural dictionary of computing.

1 Pretraining Terms

BERT

A bidirectional transformer language model pre-trained with masked language modeling and next sentence objectives. It influences how models are trained,...

Related Topics

• Transformers (1 terms in common)
• Nlp (1 terms in common)