Bonseyes AI Pipeline -- bringing AI to you. End-to-end integration of data, algorithms and deployment tools
Authors:
- Miguel de PradoMPMiguel de Prado
- Jing SuJSJing Su
- Rabia SaeedRSRabia Saeed
- Lorenzo KellerLKLorenzo Keller
- Noelia VallezNVNoelia Vallez
- Andrew AndersonAAAndrew Anderson
- David GreggDGDavid Gregg
- Luca BeniniLBLuca Benini
- Tim LlewellynnTLTim Llewellynn
- Nabil OuerhaniNONabil Ouerhani
- Rozenn DahyotRDRozenn Dahyot
- Nuria PazosNPNuria Pazos
Preprint
Abstract
Next generation of embedded Information and Communication Technology (ICT) systems are collaborative systems able to perform autonomous tasks. The remarkable expansion of the embedded ICT market, together with the rise and breakthroughs of Artificial Intelligence (AI), have put the focus on the Edge as it stands as one of the keys for the next technological revolution: the seamless integration of AI in our daily life. However, training and deployment of custom AI solutions on embedded devices require a fine-grained integration of data, algorithms, and tools to achieve high accuracy. Such integration requires a high level of expertise that becomes a real bottleneck for small and medium enterprises wanting to deploy AI solutions on the Edge which, ultimately, slows down the adoption of AI on daily-life applications. In this work, we present a modular AI pipeline as an integrating framework to bring data, algorithms, and deployment tools together. By removing the integration barriers and lowering the required expertise, we can interconnect the different stages of tools and provide a modular end-to-end development of AI products for embedded devices. Our AI pipeline consists of four modular main steps: i) data ingestion, ii) model training, iii) deployment optimization and, iv) the IoT hub integration. To show the effectiveness of our pipeline, we provide examples of different AI applications during each of the steps. Besides, we integrate our deployment framework, LPDNN, into the AI pipeline and present its lightweight architecture and deployment capabilities for embedded devices. Finally, we demonstrate the results of the AI pipeline by showing the deployment of several AI applications such as keyword spotting, image classification and object detection on a set of well-known embedded platforms, where LPDNN consistently outperforms all other popular deployment frameworks.Keywords
All Related Versions
This publication has 3 references indexed in Scilit:
- Eugene: Towards Deep Intelligence as a Service2019
- Efficient Winograd or Cook-Toom Convolution Kernel Implementation on Widely Used Mobile CPUs2019
- Musical genre classification of audio signalsIEEE Transactions on Speech and Audio Processing, 2002