Swarnali Banik
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Swarnali Banik has a total of 9 co-authors. Here are the top co-authors by number of shared publications:
- Snehanshu Saha
CSIS and APPCAIR, Birla Institute of Technology and Science Pilani Goa Campus, Zuarinagar, Goa, India
4 shared publications - Surjya Ghosh
Computer Science and Information Systems & APPCAIR, BITS Pilani, Goa, INDIA
4 shared publications - Sougata Sen
Department of Computer Science and Information Systems, BITS Pilani K.K. Birla Goa Campus, Goa, Goa, India
3 shared publications - Alfiya M. Shaikh
Computer Science and Information Systems & APPCAIR, BITS Pilani, Goa, INDIA
2 shared publications - Hrithik Nambiar
Computer Science and Information Systems & APPCAIR, BITS Pilani, Goa, INDIA
2 shared publications - Niloy Ganguly
Indian Institute of Technology Kharagpur, Kharagpur, India
2 shared publications
Latest Publications
- 20 April 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. PP (3) , 1-16
SLAB: A Self-supervised Label Generation Framework to Reduce Annotation Overhead
Recently, many emotion-aware services have been designed to improve the user experience during online video consumption (e.g., online meeting platforms, and online tutoring mediums). These services primarily deploy a machine learning model that infers user emotion continuously based on the variation in different physiological signals . However, the major challenge to developing such models is to continuously ask the users to self-report their emotions for ground truth annotation. To address these challenges, we present SLAB (Self-supervised LABel generator), a self-supervised deep learning framework for label generation to reduce the tabular data annotation overhead. SLAB utilizes two pretext tasks coupled with a novel $log-cosh$ loss function to learn useful representations from unlabeled data that apply to the downstream task of label generation. SLAB outperforms supervised learning, semi-supervised learning, and self-supervised learning baselines such as Value Imputation and Mask Estimation (VIME) on continuous emotion annotation datasets - Continuously Annotated Signals of Emotion (CASE) and K-EmoCon. We also demonstrate the generalizability of the SLAB on a unique wheelchair surface vibration dataset (in addition to four publicly available datasets from different domains). These findings highlight that SLAB significantly reduces the annotation overhead in situations where the number of unlabeled samples vastly outnumbers labeled samples.
- 20 April 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. PP (3) , 1-16
SLAB: A Self-supervised Label Generation Framework to Reduce Annotation Overhead
Recently, many emotion-aware services have been designed to improve the user experience during online video consumption (e.g., online meeting platforms, and online tutoring mediums). These services primarily deploy a machine learning model that infers user emotion continuously based on the variation in different physiological signals . However, the major challenge to developing such models is to continuously ask the users to self-report their emotions for ground truth annotation. To address these challenges, we present SLAB (Self-supervised LABel generator), a self-supervised deep learning framework for label generation to reduce the tabular data annotation overhead. SLAB utilizes two pretext tasks coupled with a novel $log-cosh$ loss function to learn useful representations from unlabeled data that apply to the downstream task of label generation. SLAB outperforms supervised learning, semi-supervised learning, and self-supervised learning baselines such as Value Imputation and Mask Estimation (VIME) on continuous emotion annotation datasets - Continuously Annotated Signals of Emotion (CASE) and K-EmoCon. We also demonstrate the generalizability of the SLAB on a unique wheelchair surface vibration dataset (in addition to four publicly available datasets from different domains). These findings highlight that SLAB significantly reduces the annotation overhead in situations where the number of unlabeled samples vastly outnumbers labeled samples.
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Influence of Demographics and Personality Traits on Physiological Responses to Improve Continuous Emotion Annotation in Video Applications
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessInfluence of Demographics and Personality Traits on Physiological Responses to Improve Continuous Emotion Annotation in Video Applications
- Open Access
- 22 August 2024
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 8 (3) , 1-32
Towards Reducing Continuous Emotion Annotation Effort During Video Consumption: A Physiological Response Profiling Approach
Emotion-aware video applications (e.g., gaming, online meetings, online tutoring) strive to moderate the content presentations for a more engaging and improved user experience. These services typically deploy a machine-learning model that continuously infers the user's emotion (based on different physiological signals, facial expressions, etc.) to adapt the content delivery. Therefore, to train such models, the emotion ground truth labels also need to be collected continuously. Typically, those are collated as emotion self-reports from users in a continuous manner (using an auxiliary device such as a joystick) when they watch some videos. This process of continuous emotion annotation not only increases the cognitive load and survey fatigue but also significantly deteriorates the viewing experience. To address this problem, we propose a framework, PResUP that probes a user for emotion self-reports opportunistically based on the physiological response variations of the user. Specifically, the framework implements a sequence of phases - (a) user profile construction based on physiological responses, (b) similar user clustering based on the user profile, and (c) training a parameterized activation-guided LSTM (Long short-term memory) model by sharing data among similar users to detect the opportune self-report collection moments. All these steps together help to reduce the continuous emotion annotation overhead by probing at the opportune moments without compromising the annotation quality. We evaluated PResUP by conducting a user study (N=36) during which the participants watched eight videos, and their physiological responses and continuous emotion self-reports were recorded. The key results from this evaluation reveal that PResUP reduces the annotation overhead by reducing the probing rate by an average of 34.80% and detects the opportune probing moments with an average TPR of 80.07% without compromising the annotation quality. Motivated by these findings, we deployed PResUP by performing a follow-up user study (N=18). In this deployment scenario, we also obtained similar performance in terms of the probing rate reduction (average reduction of 38.05%), and opportune moment detection performance (average TPR of 82.26%). These findings underscore the utility of PResUP in reducing the continuous emotion annotation effort during video consumption.
- 22 August 2024
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 8 (3) , 1-32
Open AccessTowards Reducing Continuous Emotion Annotation Effort During Video Consumption: A Physiological Response Profiling Approach
Emotion-aware video applications (e.g., gaming, online meetings, online tutoring) strive to moderate the content presentations for a more engaging and improved user experience. These services typically deploy a machine-learning model that continuously infers the user's emotion (based on different physiological signals, facial expressions, etc.) to adapt the content delivery. Therefore, to train such models, the emotion ground truth labels also need to be collected continuously. Typically, those are collated as emotion self-reports from users in a continuous manner (using an auxiliary device such as a joystick) when they watch some videos. This process of continuous emotion annotation not only increases the cognitive load and survey fatigue but also significantly deteriorates the viewing experience. To address this problem, we propose a framework, PResUP that probes a user for emotion self-reports opportunistically based on the physiological response variations of the user. Specifically, the framework implements a sequence of phases - (a) user profile construction based on physiological responses, (b) similar user clustering based on the user profile, and (c) training a parameterized activation-guided LSTM (Long short-term memory) model by sharing data among similar users to detect the opportune self-report collection moments. All these steps together help to reduce the continuous emotion annotation overhead by probing at the opportune moments without compromising the annotation quality. We evaluated PResUP by conducting a user study (N=36) during which the participants watched eight videos, and their physiological responses and continuous emotion self-reports were recorded. The key results from this evaluation reveal that PResUP reduces the annotation overhead by reducing the probing rate by an average of 34.80% and detects the opportune probing moments with an average TPR of 80.07% without compromising the annotation quality. Motivated by these findings, we deployed PResUP by performing a follow-up user study (N=18). In this deployment scenario, we also obtained similar performance in terms of the probing rate reduction (average reduction of 38.05%), and opportune moment detection performance (average TPR of 82.26%). These findings underscore the utility of PResUP in reducing the continuous emotion annotation effort during video consumption.
- 22 August 2024
- Published by Springer Nature
- p. 123-140
Self-SLAM: A Self-supervised Learning Based Annotation Method to Reduce Labeling Overhead
- 22 August 2024
- Published by Springer Nature
- p. 123-140
Self-SLAM: A Self-supervised Learning Based Annotation Method to Reduce Labeling Overhead