1. What Is Model Quantization Model quantization is the process of converting the weights and activations of a high-precision model (usually 32-bit floating point FP32 or 16-bit floating point FP16) into a low-precision model (such as 8-bit integer INT8). The value range of FP32 is -3.4*10^38 to 3.4*10^38, with 4 billion values.