Calvin B. Gealy
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Calvin B. Gealy has a total of 3 co-authors. Here are the top co-authors by number of shared publications:
- Alan D. George
University of Pittsburgh
2 shared publications - David Langerman
Department of Electrical and Computer Engineering, University of Pittsburgh, Pittsburgh, PA, USA
1 shared publication - Marika E. Schubert
Department of Electrical and Computer Engineering, University of Pittsburgh, Pittsburgh, PA, USA
1 shared publication
Latest Publications
- Open Access
- 20 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 53420-53432
SPOC: Model Metrics and Inference Scalability
The growth of deep learning has increased the challenge of understanding model performance and scalability. Model metrics are coarse-grained values that help to capture the complexity of the model. In this research, we propose SPOC (size, parameters, operations, and Critical Datapath Length) as a suite of metrics that describe much of the complexity in deep-learning architecture and therefore help to characterize their scalability. We utilize small, specially structured “micro-models” to showcase overall scalability trends across four devices: theARMCortex-A76 embedded CPU, theAMDEPYC 9374F server CPU, the NVIDIA Jetson Orin Nano embedded GPU, and the NVIDIA A100 server GPU. Through these micro-models, we vary components of SPOC and highlight different scaling behavior across these classes of devices. Finally, we provide examples of how SPOC can be used with standard CNNs and MobileViT to capture expected and measured performance differences during inference. Through this study, we provide deep-learning practitioners with an overview of how metrics can guide our understanding of inference performance.
- 20 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 53420-53432
Open AccessSPOC: Model Metrics and Inference Scalability
The growth of deep learning has increased the challenge of understanding model performance and scalability. Model metrics are coarse-grained values that help to capture the complexity of the model. In this research, we propose SPOC (size, parameters, operations, and Critical Datapath Length) as a suite of metrics that describe much of the complexity in deep-learning architecture and therefore help to characterize their scalability. We utilize small, specially structured “micro-models” to showcase overall scalability trends across four devices: theARMCortex-A76 embedded CPU, theAMDEPYC 9374F server CPU, the NVIDIA Jetson Orin Nano embedded GPU, and the NVIDIA A100 server GPU. Through these micro-models, we vary components of SPOC and highlight different scaling behavior across these classes of devices. Finally, we provide examples of how SPOC can be used with standard CNNs and MobileViT to capture expected and measured performance differences during inference. Through this study, we provide deep-learning practitioners with an overview of how metrics can guide our understanding of inference performance.
- Open Access
- 11 May 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Embedded Computing Systems
- Vol. 23 (3) , 1-35
Characterizing Parameter Scaling with Quantization for Deployment of CNNs on Real-Time Systems
Modern deep-learning models tend to include billions of parameters, reducing real-time performance. Embedded systems are compute-constrained while frequently used to deploy these models for real-time systems given size, weight, and power requirements. Tools like parameter-scaling methods help to shrink models to ease deployment. This research compares two scaling methods for convolutional neural networks, uniform scaling and NeuralScale, and analyzes their impact on inference latency, memory utilization, and power. Uniform scaling scales the number of filters evenly across a network. NeuralScale adaptively scales the model to theoretically achieve the highest accuracy for a target parameter count. In this study, VGG-11, MobileNetV2, and ResNet-50 models were scaled to four ratios: 0.25×, 0.50×, 0.75×, 1.00×. These models were benchmarked on an ARM Cortex-A72 CPU, an NVIDIA Jetson AGX Xavier GPU, and a Xilinx ZCU104 FPGA. Additionally, quantization was applied to meet real-time objectives. The CIFAR-10 and tinyImageNet datasets were studied. On CIFAR-10, NeuralScale creates more computationally intensive models than uniform scaling for the same parameter count, with relative speeds of 41% on the CPU, 72% on the GPU, and 96% on the FPGA. The additional computational complexity is a tradeoff for accuracy improvements in VGG-11 and MobileNetV2 NeuralScale models but reduced ResNet-50 NeuralScale accuracy. Furthermore, quantization alone achieves similar or better performance on the CPU and GPU devices when compared with models scaled to 0.50×, despite slight reductions in accuracy. On the GPU, quantization reduces latency by 2.7× and memory consumption by 4.3×. Uniform-scaling models are 1.8× faster and use 2.8× less memory. NeuralScale reduces latency by 1.3× and dropped memory by 1.1×. We find quantization to be a practical first tool for improved performance. Uniform scaling can easily be applied for additional improvements. NeuralScale may improve accuracy but tends to negatively impact performance, so more care must be taken with it.
- 11 May 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Embedded Computing Systems
- Vol. 23 (3) , 1-35
Open AccessCharacterizing Parameter Scaling with Quantization for Deployment of CNNs on Real-Time Systems
Modern deep-learning models tend to include billions of parameters, reducing real-time performance. Embedded systems are compute-constrained while frequently used to deploy these models for real-time systems given size, weight, and power requirements. Tools like parameter-scaling methods help to shrink models to ease deployment. This research compares two scaling methods for convolutional neural networks, uniform scaling and NeuralScale, and analyzes their impact on inference latency, memory utilization, and power. Uniform scaling scales the number of filters evenly across a network. NeuralScale adaptively scales the model to theoretically achieve the highest accuracy for a target parameter count. In this study, VGG-11, MobileNetV2, and ResNet-50 models were scaled to four ratios: 0.25×, 0.50×, 0.75×, 1.00×. These models were benchmarked on an ARM Cortex-A72 CPU, an NVIDIA Jetson AGX Xavier GPU, and a Xilinx ZCU104 FPGA. Additionally, quantization was applied to meet real-time objectives. The CIFAR-10 and tinyImageNet datasets were studied. On CIFAR-10, NeuralScale creates more computationally intensive models than uniform scaling for the same parameter count, with relative speeds of 41% on the CPU, 72% on the GPU, and 96% on the FPGA. The additional computational complexity is a tradeoff for accuracy improvements in VGG-11 and MobileNetV2 NeuralScale models but reduced ResNet-50 NeuralScale accuracy. Furthermore, quantization alone achieves similar or better performance on the CPU and GPU devices when compared with models scaled to 0.50×, despite slight reductions in accuracy. On the GPU, quantization reduces latency by 2.7× and memory consumption by 4.3×. Uniform-scaling models are 1.8× faster and use 2.8× less memory. NeuralScale reduces latency by 1.3× and dropped memory by 1.1×. We find quantization to be a practical first tool for improved performance. Uniform scaling can easily be applied for additional improvements. NeuralScale may improve accuracy but tends to negatively impact performance, so more care must be taken with it.