Mixed-Precision Quantization: Make the Best Use of Bits Where They Matter Most
- 1 September 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Signal Processing
- Vol. 19 (6) , 1218-1233
Abstract
Mixed-precision quantization offers superior performance to fixed-precision quantization. It has been widely used in signal processing, communication systems, and machine learning. In mixed-precision quantization, bit allocation is essential. Hence, in this paper, we propose a new bit allocation framework for mixed-precision quantization from a search perspective. First, we formulate a general bit allocation problem for mixed-precision quantization. Then we introduce the penalized particle swarm optimization (PPSO) algorithm to address the integer consumption constraint. To improve efficiency and avoid iterations on infeasible solutions within the PPSO algorithm, a greedy criterion particle swarm optimization (GC-PSO) algorithm is proposed. The corresponding convergence analysis is derived based on dynamical system theory. Furthermore, we apply the above framework to some specific classic fields, i.e., finite impulse response (FIR) filters, receivers, and gradient descent. Numerical examples in each application underscore the superiority of the proposed framework to the existing algorithms.Keywords
All Related Versions
Funding Information
- National Key Research and Development Program of China (2022YFB2902304)
- Natural Science Foundation of China (62471449)
- Anhui Provincial Natural Science Foundation (2308085J24)
This publication has 48 references indexed in Scilit:
- Mixed precision algorithms in numerical linear algebraActa Numerica, 2022
- Rigorous Roundoff Error Analysis of Probabilistic Floating-Point Computations2021
- Scaling up Machine Learning2011
- Telescoping rounding for suboptimal finite wordlength FIR digital filter designDigital Signal Processing, 2005
- Effects of Removing Overlapping Solutions on the Performance of the NSGA-II Algorithm2005
- Convex Optimization2004
- The particle swarm optimization algorithm: convergence analysis and parameter selectionInformation Processing Letters, 2003
- The particle swarm - explosion, stability, and convergence in a multidimensional complex spaceIEEE Transactions on Evolutionary Computation, 2002
- Analog-to-digital converter survey and analysisIEEE Journal on Selected Areas in Communications, 1999
- Efficient BackProp1998