Switched 32-Bit Fixed-Point Format for Laplacian-Distributed Data
Open Access
- 4 July 2025
- journal article
- research article
- Published by MDPI AG in Information
- Vol. 16 (7) , 574
Abstract
The 32-bit floating-point (FP32) format has many useful applications, particularly in computing and neural network systems. The classic 32-bit fixed-point (FXP32) format often introduces lower quality of representation (i.e., precision), making it unsuitable for real deployment, despite offering faster computations and reduced computational cost, which positively impacts energy efficiency. In this paper, we propose a switched FXP32 format able to compete with or surpass the widely used FP32 format across a wide variance range. It actually proposes switching between the possible values of key parameters according to the variance level of the data modeled with the Laplacian distribution. Precision analysis is achieved using the signal-to-quantization noise ratio (SQNR) as a performance metric, introduced based on the analogy between digital formats and quantization. Theoretical SQNR results provided in a wide range of variance confirm the design objectives. Experimental and simulation results obtained using neural network weights further support the approach. The strong agreement between the experiment, simulation, and theory indicates the efficiency of this proposal in encoding Laplacian data, as well as its potential applicability in neural networks.Keywords
Funding Information
- Ministry of Science, Technological Development and Innovation of the Republic of Serbia (451-03-136/2025-03/200102, 101160293)
- European Union’s Horizon 2023 research and innovation program (451-03-136/2025-03/200102, 101160293)
This publication has 17 references indexed in Scilit:
- A Novel Quantization and Model Compression Approach for Hardware Accelerators in Edge ComputingComputers, Materials & Continua, 2024
- DFXP for DNN Architectures2023
- Optimization of the fixed-point representation of measurement data for intelligent measurement systemsMeasurement, 2023
- Adaptive Precision Training (AdaPT): A dynamic quantized training approach for DNNs2023
- S-DFP: shifted dynamic fixed point for quantized deep neural network trainingNeural Computing and Applications, 2021
- Design of a 2-Bit Neural Network Quantizer for Laplacian SourceEntropy, 2021
- Floating Point and Fixed Point 32-bits Quantizers for Quantization of Weights of Neural Networks2021
- Zero-Centered Fixed-Point Quantization With Iterative Retraining for Deep Convolutional Neural Network-Based Object DetectorsIEEE Access, 2021
- IEEE Standard for Floating-Point Arithmetic2019
- Bfloat16 Processing for Neural Networks2019