Bpe Glossary
Browse 1 bpe terms defined in plain English, from the cultural dictionary of computing.
1 Bpe Terms
- Tokenizer
- The component that splits text into tokens before feeding it to a language model. Different tokenizers produce different tokens — 'unhappiness' might become...
Related Topics
- Preprocessing (1 terms in common)
- Nlp (1 terms in common)