Quantization Glossary

Browse 5 quantization terms defined in plain English, from the cultural dictionary of computing.

5 Quantization Terms

Bitnet: A family of neural-network approaches that push weights toward extremely low-bit representations, often to reduce memory use and speed up inference.
Floating Point Quantization: A compression technique that lowers numerical precision to reduce memory, bandwidth, and inference cost. It influences how models are trained, evaluated, or...
INT4: A four-bit integer numerical format commonly used for aggressive model quantization during inference. It influences how models are trained, evaluated, or...
INT8: An eight-bit integer numerical format used to reduce model size and speed up inference workloads. It influences how models are trained, evaluated, or served,...
Weight Quantization: Reducing the precision used to store or compute model weights so the model uses less memory and often runs faster. Weight quantization is a common technique...