Yes, for most techniques you’d want to do
Quantization-aware training.

→ View original post on X — @rasbt