SBSwarnali Banik

Swarnali Banik

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Swarnali Banik has a total of 9 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • SLAB: A Self-supervised Label Generation Framework to Reduce Annotation Overhead

    by Kshitish Ghate, Hrithik Nambiar, Alfiya M. Shaikh, Swarnali Banik, Surjya Ghosh, Niloy Ganguly, Snehanshu Saha

    Recently, many emotion-aware services have been designed to improve the user experience during online video consumption (e.g., online meeting platforms, and online tutoring mediums). These services primarily deploy a machine learning model that infers user emotion continuously based on the variation in different physiological signals . However, the major challenge to developing such models is to continuously ask the users to self-report their emotions for ground truth annotation. To address these challenges, we present SLAB (Self-supervised LABel generator), a self-supervised deep learning framework for label generation to reduce the tabular data annotation overhead. SLAB utilizes two pretext tasks coupled with a novel $log-cosh$ loss function to learn useful representations from unlabeled data that apply to the downstream task of label generation. SLAB outperforms supervised learning, semi-supervised learning, and self-supervised learning baselines such as Value Imputation and Mask Estimation (VIME) on continuous emotion annotation datasets - Continuously Annotated Signals of Emotion (CASE) and K-EmoCon. We also demonstrate the generalizability of the SLAB on a unique wheelchair surface vibration dataset (in addition to four publicly available datasets from different domains). These findings highlight that SLAB significantly reduces the annotation overhead in situations where the number of unlabeled samples vastly outnumbers labeled samples.

  • Open Access

    Towards Reducing Continuous Emotion Annotation Effort During Video Consumption: A Physiological Response Profiling Approach

    by Swarnali Banik, Sougata Sen, Snehanshu Saha, Surjya Ghosh

    Emotion-aware video applications (e.g., gaming, online meetings, online tutoring) strive to moderate the content presentations for a more engaging and improved user experience. These services typically deploy a machine-learning model that continuously infers the user's emotion (based on different physiological signals, facial expressions, etc.) to adapt the content delivery. Therefore, to train such models, the emotion ground truth labels also need to be collected continuously. Typically, those are collated as emotion self-reports from users in a continuous manner (using an auxiliary device such as a joystick) when they watch some videos. This process of continuous emotion annotation not only increases the cognitive load and survey fatigue but also significantly deteriorates the viewing experience. To address this problem, we propose a framework, PResUP that probes a user for emotion self-reports opportunistically based on the physiological response variations of the user. Specifically, the framework implements a sequence of phases - (a) user profile construction based on physiological responses, (b) similar user clustering based on the user profile, and (c) training a parameterized activation-guided LSTM (Long short-term memory) model by sharing data among similar users to detect the opportune self-report collection moments. All these steps together help to reduce the continuous emotion annotation overhead by probing at the opportune moments without compromising the annotation quality. We evaluated PResUP by conducting a user study (N=36) during which the participants watched eight videos, and their physiological responses and continuous emotion self-reports were recorded. The key results from this evaluation reveal that PResUP reduces the annotation overhead by reducing the probing rate by an average of 34.80% and detects the opportune probing moments with an average TPR of 80.07% without compromising the annotation quality. Motivated by these findings, we deployed PResUP by performing a follow-up user study (N=18). In this deployment scenario, we also obtained similar performance in terms of the probing rate reduction (average reduction of 38.05%), and opportune moment detection performance (average TPR of 82.26%). These findings underscore the utility of PResUP in reducing the continuous emotion annotation effort during video consumption.


  • Self-SLAM: A Self-supervised Learning Based Annotation Method to Reduce Labeling Overhead

    by Alfiya M. Shaikh, Hrithik Nambiar, Kshitish Ghate, Swarnali Banik, Sougata Sen, Surjya Ghosh, Vaskar Raychoudhury, Niloy Ganguly, Snehanshu Saha