Performance Comparison of Machine Learning Across Metal, Cuda, and Software-Based Neuromorphic Simulation

Authors:
Open Access
Publisher website
Google Scholar
Abstract
Machine learning’s computational demands necessitate optimal performance and utilization across diverse hardware architectures. This research compares computing as spiking neural networks (CSNNs, or simulated neuromorphic computing) and regular CNNs on Apple Silicon M3 Pro with Metal Performance Shaders (MPS), and NVIDIA RTX 3070 GPU with CUDA. We run Convolutional Spiking Neural Networks (CSNNs) and traditional CNNs on two datasets (frame-based CIFAR-10; and sequential event-based DVS) to evaluate the suitability of neural net architectures and platforms for different data problems. For both CSNNs and traditional CNNs, Apple Silicon with MPS delivers better energy efficiency but longer processing times for training and inference. NVIDIA with CUDA offers faster computation in training and inference at higher energy costs for CNNs. For CSNNs, frame-based data (CIFAR-10) significantly degraded performance when proper temporal encoding was absent, while event-based data (DVS) proved more naturally suited to the CSNN architecture than frame-based inputs. Though CNNs still achieved higher empirical accuracy in the reported experiments. CSNNs also performed better on Apple Silicon (with MPS) for the sequential event-based data. RAM utilization patterns favored Apple Silicon (with MPS) across both data experiments. The CSNN architecture demanded higher memory resources than CNN, regardless of platform and dataset. NVIDIA (with CUDA) was less energy efficient for spiking neural networks (CSNNs) as compared to Apple Silicon (with MPS). We also compared how the number of time steps affects accuracy and energy consumption across hardware platforms, finding that higher accuracy correlates with energy costs as time steps increase; the accuracy-energy relation seems linear for frame-based data, while for event-based data the energy consumption remains stable increasing at higher time steps. Our cross-platform performance analysis of spiking and regular neural network architectures highlight the importance of matching platform-architecture combinations to a dataset and application requirements.

This publication has 19 references indexed in Scilit: