BigEAR: Inferring the Ambient and Emotional Correlates from Smartphone-Based Acoustic Big Data
- 18 August 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 78-83
Abstract
This paper presents a novel BigEAR big data framework that employs psychological audio processing chain (PAPC) to process smartphone-based acoustic big data collected when the user performs social conversations in naturalistic scenarios. The overarching goal of BigEAR is to identify moods of the wearer from various activities such as laughing, singing, crying, arguing, and sighing. These annotations are based on ground truth relevant for psychologists who intend to monitor/infer the social context of individuals coping with breast cancer. We pursued a case study on couples coping with breast cancer to know how the conversations affect emotional and social well being. In the state-of-the-art methods, psychologists and their team have to hear the audio recordings for making these inferences by subjective evaluations that not only are time-consuming and costly, but also demand manual data coding for thousands of audio files. The BigEAR framework automates the audio analysis. We computed the accuracy of BigEAR with respect to the ground truth obtained from a human rater. Our approach yielded overall average accuracy of 88.76% on real-world data from couples coping with breast cancer.Keywords
All Related Versions
This publication has 25 references indexed in Scilit:
- Fit: A Fog Computing Device for Speech Tele-Treatments2016
- A multi-smartwatch system for assessing speech characteristics of people with dysarthria in group settings2015
- Deep Learning for Emotional Speech RecognitionLecture Notes in Computer Science, 2014
- Naturalistic Observation of Health-Relevant Social ProcessesPsychosomatic Medicine, 2012
- A Regression Approach to Music Emotion RecognitionIEEE Transactions on Audio, Speech, and Language Processing, 2008
- Speech Emotion Recognition Using Spectral Entropy2008
- Psychoacoustics2007
- InSense: Interest-Based Life LoggingIEEE MultiMedia, 2006
- Spectral subband centroid features for speech recognition1998
- Transform coding of audio signals using perceptual noise criteriaIEEE Journal on Selected Areas in Communications, 1988