What does INT8 quantization accomplish when applied to a neural network deployed on a Jetson device?
-
A
It increases model accuracy by using higher-precision weights
-
B
It reduces model size and increases throughput by representing weights with 8-bit integers instead of 32-bit floats
-
C
It encrypts the model weights for secure edge deployment
-
D
It converts the model to run exclusively on the Jetson CPU