Application of Machine Learning Model on Streaming Health Data Event in Real-Time to Predict Health Status Using Spark
Authors:
- 1 November 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-4
Abstract
In healthcare field, a huge amount of data collected in real-time by IoT systems, remote sensing device and other data collection tools brings new challenges that focus primarily on data size and the fast growth rate of such large data. Applying machine learning model on this voluminous data having varying velocity becomes extremely complex for traditional methods of data mining. To deal with this challenge, Apache Spark, a powerful big data processing tool can be used successfully for streaming data event against machine learning through in-memory and distributed computations. This work aims at developing a real-time health status prediction system with breast cancer use case using spark streaming framework with machine learning especially Decision Tree. The system focus on applying machine learning model on streaming data coming with rapid rate to predict health status based on several input variables. Based on this, the system first preprocesses the dataset and analyzes it to create an offline model for learning system, the model then deployed on system and use it in real-time to predict health status.Keywords
This publication has 12 references indexed in Scilit:
- Optimal breast cancer classification using Gauss–Newton representation based algorithmExpert Systems with Applications, 2017
- Predicting the risk of diabetes in big data electronic health Records by using scalable random forest classification algorithm2016
- Real-time Medical Emergency Response System: Exploiting IoT and Big Data for Public HealthJournal of Medical Systems, 2016
- Automatic cell nuclei segmentation and classification of breast cancer histopathology imagesSignal Processing, 2016
- A new classifier for breast cancer detection based on Naïve BayesianMeasurement, 2015
- Live Migration of Virtual Machines in Cloud Environment: A SurveyIndian Journal of Science and Technology, 2015
- Real-time disease surveillance using Twitter data2013
- Support vector machines combined with feature selection for breast cancer diagnosisExpert Systems with Applications, 2009
- Implementing automated diagnostic systems for breast cancer detectionExpert Systems with Applications, 2007
- Mining association rules between sets of items in large databases1993