Decoding Glossary
Browse 9 decoding terms defined in plain English, from the cultural dictionary of computing.
9 Decoding Terms
- Beam Search
- A decoding strategy that keeps the top-scoring partial sequences instead of only the single best candidate. It influences how models are trained, evaluated, or...
- Length Penalty
- A decoding parameter or scoring adjustment that discourages or encourages longer outputs when selecting among generated sequences. Length penalties are used to...
- Logprob
- The logarithm of a probability assigned by a model to a token or sequence, commonly used for numerical stability in scoring and decoding. Logprobs are useful...
- Model Temperature
- The temperature setting applied during generation to make output more deterministic or more varied. Higher temperature generally increases randomness, while...
- Parallel Decoding
- Methods that generate or verify multiple output tokens in parallel to reduce latency compared with strictly sequential decoding.
- Penalty
- A cost or discouraging adjustment applied during optimization or generation to reduce unwanted behavior such as repetition, excessive length, or policy...
- Repetition Penalty
- A decoding adjustment that discourages a model from repeating the same tokens, words, or phrases too often during generation. Repetition penalties help reduce...
- Self-Consistency
- A prompting or decoding strategy in which multiple reasoning paths or outputs are generated and then compared to select the most consistent answer....
- Stop Sequence
- A token sequence that tells a generation system where to stop producing output when that sequence appears. Stop sequences are used to control output boundaries...
Related Topics
- Ai (7 terms in common)
- Generation (3 terms in common)
- Probability (1 terms in common)
- Optimization (1 terms in common)
- Search (1 terms in common)
- Nlp (1 terms in common)
- Performance (1 terms in common)
- Inference (1 terms in common)
- Reasoning (1 terms in common)
- Models (1 terms in common)