Run-Time Prevention of Software Integration Failures of Machine Learning APIs
Open Access
- 16 October 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Programming Languages
- Vol. 7 (OOPSLA2) , 264-291
Abstract
Due to the under-specified interfaces, developers face challenges in correctly integrating machine learning (ML) APIs in software. Even when the ML API and the software are well designed on their own, the resulting application misbehaves when the API output is incompatible with the software. It is desirable to have an adapter that converts ML API output at runtime to better fit the software need and prevent integration failures. In this paper, we conduct an empirical study to understand ML API integration problems in real-world applications. Guided by this study, we present SmartGear, a tool that automatically detects and converts mismatching or incorrect ML API output at run time, serving as a middle layer between ML API and software. Our evaluation on a variety of open-source applications shows that SmartGear detects 70% incompatible API outputs and prevents 67% potential integration failures, outperforming alternative solutions.Keywords
This publication has 37 references indexed in Scilit:
- Complexity vs. performance2017
- Statically Checking Web API Requests in JavaScript2017
- Metamorphic Model-Based Testing of Autonomous Systems2017
- Trials and tribulations of developers of intelligent systems: A field study2016
- Testing of Autonomous Systems – Challenges and Current State‐of‐the‐ArtINCOSE International Symposium, 2016
- The emerging role of data scientists on software development teams2016
- Segmentation-free handwritten Chinese text recognition with LSTM-RNN2015
- Food image recognition using deep convolutional network with pre-training and fine-tuning2015
- Automatic runtime error repair and containment via recovery shepherding2014
- CVC42011