IIsy: Hybrid In-Network Classification Using Programmable Switches

Authors:
Top Cited Papers
Publisher website
Google Scholar
Abstract
The soaring use of machine learning leads to increasing processing demands. As data volume keeps growing, providing classification services with good machine learning performance, high throughput, low latency, and minimal equipment overheads becomes a challenge. Offloading machine learning tasks to network switches can be a scalable solution to this problem, providing high throughput and low latency. However, network devices are resource constrained, and lack support for machine learning functionality. In this paper, we introduce IIsy -a novel mapping tool of machine learning classification models to off-the-shelf switches. Using an efficient encoding algorithm, enables fitting a range of classification models on switches, co-existing with standard switch functionality. To overcome resource constraints, adopts a hybrid approach for ensemble models, running a small model on a switch and a large model on the backend. The evaluation shows that achieves near-optimal classification results, within minimum resource overheads, and while reducing the load on the backend by 70% for data-intensive use cases.
Funding Information
  • VMware
  • Innovate U.K. (10056403)
  • SmartEdge European Union (EU) Project (101092908)
  • Leverhulme Trust (ECF-2016-289)
  • Isaac Newton Trust
  • Intel

This publication has 56 references indexed in Scilit: