CGCalvin B. Gealy

Calvin B. Gealy

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Calvin B. Gealy has a total of 3 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    SPOC: Model Metrics and Inference Scalability

    by Calvin B. Gealy, David Langerman, Marika E. Schubert, Alan D. George

    The growth of deep learning has increased the challenge of understanding model performance and scalability. Model metrics are coarse-grained values that help to capture the complexity of the model. In this research, we propose SPOC (size, parameters, operations, and Critical Datapath Length) as a suite of metrics that describe much of the complexity in deep-learning architecture and therefore help to characterize their scalability. We utilize small, specially structured “micro-models” to showcase overall scalability trends across four devices: theARMCortex-A76 embedded CPU, theAMDEPYC 9374F server CPU, the NVIDIA Jetson Orin Nano embedded GPU, and the NVIDIA A100 server GPU. Through these micro-models, we vary components of SPOC and highlight different scaling behavior across these classes of devices. Finally, we provide examples of how SPOC can be used with standard CNNs and MobileViT to capture expected and measured performance differences during inference. Through this study, we provide deep-learning practitioners with an overview of how metrics can guide our understanding of inference performance.


  • Open Access

    Characterizing Parameter Scaling with Quantization for Deployment of CNNs on Real-Time Systems

    by Calvin B. Gealy, Alan D. George

    Modern deep-learning models tend to include billions of parameters, reducing real-time performance. Embedded systems are compute-constrained while frequently used to deploy these models for real-time systems given size, weight, and power requirements. Tools like parameter-scaling methods help to shrink models to ease deployment. This research compares two scaling methods for convolutional neural networks, uniform scaling and NeuralScale, and analyzes their impact on inference latency, memory utilization, and power. Uniform scaling scales the number of filters evenly across a network. NeuralScale adaptively scales the model to theoretically achieve the highest accuracy for a target parameter count. In this study, VGG-11, MobileNetV2, and ResNet-50 models were scaled to four ratios: 0.25×, 0.50×, 0.75×, 1.00×. These models were benchmarked on an ARM Cortex-A72 CPU, an NVIDIA Jetson AGX Xavier GPU, and a Xilinx ZCU104 FPGA. Additionally, quantization was applied to meet real-time objectives. The CIFAR-10 and tinyImageNet datasets were studied. On CIFAR-10, NeuralScale creates more computationally intensive models than uniform scaling for the same parameter count, with relative speeds of 41% on the CPU, 72% on the GPU, and 96% on the FPGA. The additional computational complexity is a tradeoff for accuracy improvements in VGG-11 and MobileNetV2 NeuralScale models but reduced ResNet-50 NeuralScale accuracy. Furthermore, quantization alone achieves similar or better performance on the CPU and GPU devices when compared with models scaled to 0.50×, despite slight reductions in accuracy. On the GPU, quantization reduces latency by 2.7× and memory consumption by 4.3×. Uniform-scaling models are 1.8× faster and use 2.8× less memory. NeuralScale reduces latency by 1.3× and dropped memory by 1.1×. We find quantization to be a practical first tool for improved performance. Uniform scaling can easily be applied for additional improvements. NeuralScale may improve accuracy but tends to negatively impact performance, so more care must be taken with it.