Sampling Glossary

Browse 2 sampling terms defined in plain English, from the cultural dictionary of computing.

2 Sampling Terms

Temperature
A parameter that controls the randomness of a language model's output. Lower temperatures (0.0–0.3) make outputs more deterministic and focused; higher...
Token Sampling
The process of selecting output tokens from a probability distribution during generation rather than always taking the single highest-probability choice. Token...

Related Topics