Smart Assistive Architecture for the Integration of IoT Devices, Robotic Systems, and Multimodal Interfaces in Healthcare Environments
Open Access
Abstract
This paper presents a new architecture that integrates Internet of Things (IoT) devices, service robots, and users in a smart assistive environment. A new intuitive and multimodal interaction system supporting people with disabilities and bedbound patients is presented. This interaction system allows the user to control service robots and devices inside the room in five different ways: touch control, eye control, gesture control, voice control, and augmented reality control. The interaction system is comprised of an assistive robotic arm holding a tablet PC. The robotic arm can place the tablet PC in front of the user. A demonstration of the developed technology, a prototype of a smart room equipped with home automation devices, and the robotic assistive arm are presented. The results obtained from the use of the various interfaces and technologies are presented in the article. The results include user preference with regard to eye-base control (performing clicks, and using winks or gaze) and the use of mobile phones over augmented reality glasses, among others.Keywords
Funding Information
- Ministerio de Ciencia e Innovación (DPI2013-47944-C4-2-R)
This publication has 43 references indexed in Scilit:
- Multimodal interface for smart home2016
- 3D gaze cursor: Continuous calibration and end-point grasp control of robotic actuators2016
- User Interfaces in Smart Assistive Environments2016
- Smart Tablet Monitoring by a Real-Time Head Movement and Eye Gestures Recognition System2014
- A Low-Computational Approach on Gaze Estimation With Eye Touch SystemIEEE Transactions on Cybernetics, 2013
- Potential use of robots in Taiwanese nursing homes2013
- A multimodal ubiquitous interface system using smart phone for human-robot interaction2011
- PEIS Ecology: integrating robots into smart environments2006
- Asymmetry of BlinkingInvestigative Ophthalmology & Visual Science, 2006
- Toward multimodal human-computer interfaceProceedings of the IEEE, 1998