Pradipta Biswas
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Pradipta Biswas has a total of 179 co-authors. Here are the top co-authors by number of shared publications:
Pat Langdon
19 shared publications- Abhishek Mukhopadhyay
Amity University, Kolkata, India
12 shared publications Gowdham Prabhakar
I3D Lab, Centre for Product Design and Manufacturing, Indian Institute of Science (IISc), Bengaluru, India
11 shared publicationsPatrick Langdon
University of Cambridge
9 shared publications- L. R. D. Murthy
Mercedes Benz Research and Development India, Bangalore, India
6 shared publications Peter Robinson
Computer Laboratory , University of Cambridge , UK
6 shared publications
Latest Publications
- Open Access
- 2 May 2026
- Published by Elsevier in SSRN Electronic Journal
Improving MR Interaction through Gen AI
Mixed Reality (MR) systems integrate digital guidance with physical environments to supportindustrial task execution; however, reliable object detection remains challenging due to occlusion, lighting variation, and limited annotated data. This work addresses data scarcity through diffusion based generative augmentation that expands low-resource industrial datasets with realistic synthetic tool instances under diverse background and illumination conditions, targeting detection failure cases. To validate the effectiveness of the synthetic dataset beyond offline detection metrics, this work conducts a user study in a real MR task execution setting, where detection stability affects the alignment and usability of visual guidance. The study compares three MR assistance modes, Textual Guidance, Bounding Box Guidance, and Holographic Guidance, to assess their impact on user performance, cognitive workload, and usability across varying lighting conditions. Results show that hologram guidance improve visual search time and task performance, with holographic guidancereducing task completion time by 21.4% and workload by 41.9% relative to textual guidance, while increasing usability by 33.4%. These findings demonstrate that diffusion-augmented synthetic data improves object detection robustness and translates into measurable gains in human-centered MR task performance.
- 2 May 2026
- Published by Elsevier in SSRN Electronic Journal
Open AccessImproving MR Interaction through Gen AI
Mixed Reality (MR) systems integrate digital guidance with physical environments to supportindustrial task execution; however, reliable object detection remains challenging due to occlusion, lighting variation, and limited annotated data. This work addresses data scarcity through diffusion based generative augmentation that expands low-resource industrial datasets with realistic synthetic tool instances under diverse background and illumination conditions, targeting detection failure cases. To validate the effectiveness of the synthetic dataset beyond offline detection metrics, this work conducts a user study in a real MR task execution setting, where detection stability affects the alignment and usability of visual guidance. The study compares three MR assistance modes, Textual Guidance, Bounding Box Guidance, and Holographic Guidance, to assess their impact on user performance, cognitive workload, and usability across varying lighting conditions. Results show that hologram guidance improve visual search time and task performance, with holographic guidancereducing task completion time by 21.4% and workload by 41.9% relative to textual guidance, while increasing usability by 33.4%. These findings demonstrate that diffusion-augmented synthetic data improves object detection robustness and translates into measurable gains in human-centered MR task performance.
- 8 October 2025
- Published by Springer Nature in Journal on Multimodal User Interfaces
- Vol. 19 (4) , 345-362
Studying human modality preferences in a human-drone framework for secondary task selection
- 8 October 2025
- Published by Springer Nature in Journal on Multimodal User Interfaces
- Vol. 19 (4) , 345-362
Studying human modality preferences in a human-drone framework for secondary task selection
- Open Access
- 22 July 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Human-Robot Interaction
- Vol. 14 (4) , 1-33
Investigating Inverse Reinforcement Learning during Rapid Aiming Movement in Extended Reality and Human-Robot Interaction
Rapid aiming movement involves quick, accurate, pre-programmed motions used in the context of human-computer and human-robot interaction. It incorporates target forecasting to minimize the duration of tasks requiring rapid aiming. Applications include predicting target icons in UI design, driver intent in automotive technology, and human intent during human-robot collaboration. Conventional approaches often fail to capture human preferences accurately, leading to low prediction accuracy. This work explores an Inverse Reinforcement Learning (IRL)-based system for forecasting human hand movements and intended targets during rapid aiming. Sampling-based Maximum Entropy IRL (SMEIRL) with a sampler and Maximum Entropy Deep IRL (MEDIRL) algorithms were evaluated for prediction accuracy. The proposed sampler efficiently generates sample trajectories for rapid aiming tasks. User studies were conducted to assess target prediction during two tasks involving rapid aiming movement: (1) Pointing in Virtual Reality (VR) and Mixed Reality (MR), and (2) Human-robot handovers. A multimodal target prediction algorithm was analyzed for swift and accurate anticipation of the intended target, considering both hand and eye gaze. Results demonstrate that the proposed approach achieves a prediction accuracy of 98% in MR and 96% in VR for the pointing task using SMEIRL. During human-robot handover task, prediction accuracy using MEDIRL reached 99.9% when less than 20% and 40% of the task was left using only hand motion or both hand and eye gaze, respectively, surpassing state-of-the-art methods using Path Integral-IRL (PI-IRL), Recurrent Neural Network-Inverse Kinematics-Modified Kalman Filtering (RNNIK-MKF), Bayesian Predictor for Human Motion Trajectory (BP-HMT), and Classical kinematics of motion ( \(CM_{k=5}\) ).- 22 July 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Human-Robot Interaction
- Vol. 14 (4) , 1-33
Open AccessInvestigating Inverse Reinforcement Learning during Rapid Aiming Movement in Extended Reality and Human-Robot Interaction
Rapid aiming movement involves quick, accurate, pre-programmed motions used in the context of human-computer and human-robot interaction. It incorporates target forecasting to minimize the duration of tasks requiring rapid aiming. Applications include predicting target icons in UI design, driver intent in automotive technology, and human intent during human-robot collaboration. Conventional approaches often fail to capture human preferences accurately, leading to low prediction accuracy. This work explores an Inverse Reinforcement Learning (IRL)-based system for forecasting human hand movements and intended targets during rapid aiming. Sampling-based Maximum Entropy IRL (SMEIRL) with a sampler and Maximum Entropy Deep IRL (MEDIRL) algorithms were evaluated for prediction accuracy. The proposed sampler efficiently generates sample trajectories for rapid aiming tasks. User studies were conducted to assess target prediction during two tasks involving rapid aiming movement: (1) Pointing in Virtual Reality (VR) and Mixed Reality (MR), and (2) Human-robot handovers. A multimodal target prediction algorithm was analyzed for swift and accurate anticipation of the intended target, considering both hand and eye gaze. Results demonstrate that the proposed approach achieves a prediction accuracy of 98% in MR and 96% in VR for the pointing task using SMEIRL. During human-robot handover task, prediction accuracy using MEDIRL reached 99.9% when less than 20% and 40% of the task was left using only hand motion or both hand and eye gaze, respectively, surpassing state-of-the-art methods using Path Integral-IRL (PI-IRL), Recurrent Neural Network-Inverse Kinematics-Modified Kalman Filtering (RNNIK-MKF), Bayesian Predictor for Human Motion Trajectory (BP-HMT), and Classical kinematics of motion ( \(CM_{k=5}\) ). - Open Access
- 18 June 2025
- Published by Springer Nature in Discover Robotics
- Vol. 1 (1) , 1-12
Comparing computer vision models for low resource dataset to develop a mixed reality based manual assembly assistant
Assembling complex components often requires expert guidance. Augmented Reality (AR) offers intuitive visual assistance that can enhance user performance, yet existing AR-based systems largely focus on simple tasks, limiting their application to intricate assembly scenarios. This paper addresses the gap by developing a comprehensive pipeline for AI and AR-based assembly guidance. We analyzed various software architectures, selecting the optimal setup for advanced manufacturing based on latency, accuracy, and human factors. A novel AI-based hologram registration technique was implemented to provide real-time assistance in dynamic environments. Additionally, a multimodal user interface was designed to facilitate seamless interaction with the Mixed Reality (MR) system, allowing users to access instructions efficiently. Results demonstrate that users completed tasks faster with the MR system compared to traditional video-based methods. The proposed system also significantly reduces cognitive load and improves usability, positioning it as an effective tool for modern manufacturing.
- 18 June 2025
- Published by Springer Nature in Discover Robotics
- Vol. 1 (1) , 1-12
Open AccessComparing computer vision models for low resource dataset to develop a mixed reality based manual assembly assistant
Assembling complex components often requires expert guidance. Augmented Reality (AR) offers intuitive visual assistance that can enhance user performance, yet existing AR-based systems largely focus on simple tasks, limiting their application to intricate assembly scenarios. This paper addresses the gap by developing a comprehensive pipeline for AI and AR-based assembly guidance. We analyzed various software architectures, selecting the optimal setup for advanced manufacturing based on latency, accuracy, and human factors. A novel AI-based hologram registration technique was implemented to provide real-time assistance in dynamic environments. Additionally, a multimodal user interface was designed to facilitate seamless interaction with the Mixed Reality (MR) system, allowing users to access instructions efficiently. Results demonstrate that users completed tasks faster with the MR system compared to traditional video-based methods. The proposed system also significantly reduces cognitive load and improves usability, positioning it as an effective tool for modern manufacturing.
- Open Access
- 24 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 74-77
LMD-FISH: Language Model Driven - Framework for Intelligent Scheduling of Heterogenous Systems
- 24 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 74-77
Open AccessLMD-FISH: Language Model Driven - Framework for Intelligent Scheduling of Heterogenous Systems
- Open Access
- 24 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 538-552
Diffuse Your Data Blues: Augmenting Low-Resource Datasets via User-Assisted Diffusion
- 24 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 538-552
Open AccessDiffuse Your Data Blues: Augmenting Low-Resource Datasets via User-Assisted Diffusion
- 28 November 2024
- Published by Springer Nature in Signal, Image and Video Processing
- Vol. 19 (1) , 1-10
I-rod: an ensemble of CNNs for object detection in unconstrained road scenarios
- 28 November 2024
- Published by Springer Nature in Signal, Image and Video Processing
- Vol. 19 (1) , 1-10
I-rod: an ensemble of CNNs for object detection in unconstrained road scenarios
- 11 November 2024
- Published by Springer Nature in Journal on Multimodal User Interfaces
- Vol. 18 (4) , 331-349
HaM3D: generalized XR-based multimodal HRI framework with haptic feedback for industry 4.0
- 11 November 2024
- Published by Springer Nature in Journal on Multimodal User Interfaces
- Vol. 18 (4) , 331-349
HaM3D: generalized XR-based multimodal HRI framework with haptic feedback for industry 4.0
- Top Cited PapersOpen Access
- 30 September 2024
- Published by Association for Computing Machinery (ACM) in Digital Government: Research and Practice
- Vol. 5 (3) , 1-28
Accessibility Analysis of Educational Websites Using WCAG 2.0
In recent years, the internet has emerged as the primary information hub, encompassing various domains such as education, healthcare, government, and e-commerce. With a vast user base relying on websites for accessing essential information, ensuring web content accessibility has become imperative. Meeting accessibility guidelines is crucial to accommodate users with diverse abilities worldwide. This article examines accessibility variances among education board websites hosting higher-level school leaving examinations. The study evaluates the landing pages of 13 educational websites from both developing and developed countries, employing six Web Content Accessibility Guidelines (WCAG) tools endorsed by the World Wide Web Consortium (W3C). The study has meticulously compiled the outcomes of each assessment tool, delineating the diverse accessibility concerns encountered on each website. Furthermore, alternative recommendations have been proposed to assist web developers in rectifying these issues. The findings underscore a higher prevalence of accessibility issues within the education board websites of developing countries compared to their developed counterparts. Specifically, the analysis revealed prominent text contrast failures among selected web pages from developing nations, while non-text contrast failures were more prevalent in those from developed countries. Notably, the education board websites of India and Japan emerged with the highest number of accessibility issues among the sampled websites. As a way forward, a case study was shown on using LLM for making websites accessible.
- 30 September 2024
- Published by Association for Computing Machinery (ACM) in Digital Government: Research and Practice
- Vol. 5 (3) , 1-28
Top Cited PapersOpen AccessAccessibility Analysis of Educational Websites Using WCAG 2.0
In recent years, the internet has emerged as the primary information hub, encompassing various domains such as education, healthcare, government, and e-commerce. With a vast user base relying on websites for accessing essential information, ensuring web content accessibility has become imperative. Meeting accessibility guidelines is crucial to accommodate users with diverse abilities worldwide. This article examines accessibility variances among education board websites hosting higher-level school leaving examinations. The study evaluates the landing pages of 13 educational websites from both developing and developed countries, employing six Web Content Accessibility Guidelines (WCAG) tools endorsed by the World Wide Web Consortium (W3C). The study has meticulously compiled the outcomes of each assessment tool, delineating the diverse accessibility concerns encountered on each website. Furthermore, alternative recommendations have been proposed to assist web developers in rectifying these issues. The findings underscore a higher prevalence of accessibility issues within the education board websites of developing countries compared to their developed counterparts. Specifically, the analysis revealed prominent text contrast failures among selected web pages from developing nations, while non-text contrast failures were more prevalent in those from developed countries. Notably, the education board websites of India and Japan emerged with the highest number of accessibility issues among the sampled websites. As a way forward, a case study was shown on using LLM for making websites accessible.