Amar Jaiswal
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Amar Jaiswal has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Ingebrigt Meisingset
Department of Public Health and Nursing, Norwegian University of Science and Technology (NTNU), Trondheim, Norway
3 shared publications - Kerstin Bach
Norwegian University of Science and Technology
3 shared publications - Fredrik Granviken
Department of Public Health and Nursing, Norwegian University of Science and Technology (NTNU), Trondheim, Norway
2 shared publications - Kassaye Yitbarek Yigzaw
Norwegian Centre for E-health Research, Troms, Norway
2 shared publications - Mohit Kumar
School of Electronics Engineering, VIT-AP University, Amaravati, Andhra Pradesh, India
2 shared publications - Ottar Vasseljen
Department of Public Health and Nursing, Norwegian University of Science and Technology (NTNU), Trondheim, Norway
2 shared publications
Latest Publications
- Open Access
- 1 May 2025
- Published by Elsevier in International Journal of Medical Informatics
- Vol. 201, 105919
SupportPrim CDSS: A clinical decision support system architecture based on microservices for non-specific musculoskeletal disorders
- 1 May 2025
- Published by Elsevier in International Journal of Medical Informatics
- Vol. 201, 105919
Open AccessSupportPrim CDSS: A clinical decision support system architecture based on microservices for non-specific musculoskeletal disorders
- Open Access
- 12 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 195370-195395
FaN-REMs: Fair and Normalized Retrieval Evaluation Metrics for Learning Retrieval Systems
Background: Retrieval evaluation metrics are vital for resilient artificial intelligence (AI) retrieval systems and its subfields, such as case-based reasoning (CBR). Despite extensive research in CBR over the decades, the field still lacks a specialized retrieval evaluation metric (REM). Purpose: This study aims to critically investigate and devise retrieval evaluation metrics that are generic, fair, normalized, and non-deceptive, which make it suitable for domains including learning retrieval systems such as CBR. It focuses on enhancing CBR retrievals by addressing key flaws in widely used metrics, including the normalized discounted cumulative gain at k ( nDCG @ k ) metric in IR. Method: The proposed method entails devising a fair and normalized (FaN) relevancy metric for a case retrieved against a test query, blending system-generated and oracle-evaluated relevancies. This underpins three rank-based metrics: relevancy at k ( R @ k ), average relevancy at k ( AR @ k ), and mean average relevancy at k ( MAR @ k ). These metrics are designed for both single and multiple query evaluations and offer a comprehensive retrieval analysis. Result: Despite inherent challenges in evaluating evaluation metrics, FaN-REMs demonstrated robust performance across plausible domain values for the FaN relevancy function. These metrics effectively assess retrievals across different implementations, similarity measures, and applications, with inherent normalization allowing for comparisons across heterogeneous systems. These metrics were instrumental in developing a CBR-based clinical decision support system (CDSS) for the SupportPrim study in Norway, demonstrating the practical application and relevance of this research in real-world AI systems. Conclusion: FaN-REMs show promise as benchmark metrics to compare various retrieval and CBR systems. Suitable for set-based and rank-based evaluations, rank-based FaN-REMs demonstrate superior discriminatory capability. The experimental results affirm the viability of FaN-REMs in real-world CBR system development and maintenance.
- 12 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 195370-195395
Open AccessFaN-REMs: Fair and Normalized Retrieval Evaluation Metrics for Learning Retrieval Systems
Background: Retrieval evaluation metrics are vital for resilient artificial intelligence (AI) retrieval systems and its subfields, such as case-based reasoning (CBR). Despite extensive research in CBR over the decades, the field still lacks a specialized retrieval evaluation metric (REM). Purpose: This study aims to critically investigate and devise retrieval evaluation metrics that are generic, fair, normalized, and non-deceptive, which make it suitable for domains including learning retrieval systems such as CBR. It focuses on enhancing CBR retrievals by addressing key flaws in widely used metrics, including the normalized discounted cumulative gain at k ( nDCG @ k ) metric in IR. Method: The proposed method entails devising a fair and normalized (FaN) relevancy metric for a case retrieved against a test query, blending system-generated and oracle-evaluated relevancies. This underpins three rank-based metrics: relevancy at k ( R @ k ), average relevancy at k ( AR @ k ), and mean average relevancy at k ( MAR @ k ). These metrics are designed for both single and multiple query evaluations and offer a comprehensive retrieval analysis. Result: Despite inherent challenges in evaluating evaluation metrics, FaN-REMs demonstrated robust performance across plausible domain values for the FaN relevancy function. These metrics effectively assess retrievals across different implementations, similarity measures, and applications, with inherent normalization allowing for comparisons across heterogeneous systems. These metrics were instrumental in developing a CBR-based clinical decision support system (CDSS) for the SupportPrim study in Norway, demonstrating the practical application and relevance of this research in real-world AI systems. Conclusion: FaN-REMs show promise as benchmark metrics to compare various retrieval and CBR systems. Suitable for set-based and rank-based evaluations, rank-based FaN-REMs demonstrate superior discriminatory capability. The experimental results affirm the viability of FaN-REMs in real-world CBR system development and maintenance.
- 31 July 2024
- Published by Springer Nature
- p. 259-269
CBR Evaluation Pyramid: A Pragmatic Process for Evaluating Case-Based Reasoning Systems
- 31 July 2024
- Published by Springer Nature
- p. 259-269
CBR Evaluation Pyramid: A Pragmatic Process for Evaluating Case-Based Reasoning Systems
- Open Access
- 10 May 2024
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 8 (1) , e44805
Decision Support for Managing Common Musculoskeletal Pain Disorders: Development of a Case-Based Reasoning Application
Background: Common interventions for musculoskeletal pain disorders either lack evidence to support their use or have small to modest or short-term effects. Given the heterogeneity of patients with musculoskeletal pain disorders, treatment guidelines and systematic reviews have limited transferability to clinical practice. A problem-solving method in artificial intelligence, case-based reasoning (CBR), where new problems are solved based on experiences from past similar problems, might offer guidance in such situations. Objective: This study aims to use CBR to build a decision support system for patients with musculoskeletal pain disorders seeking physiotherapy care. This study describes the development of the CBR system SupportPrim PT and demonstrates its ability to identify similar patients. Methods: Data from physiotherapy patients in primary care in Norway were collected to build a case base for SupportPrim PT. We used the local-global principle in CBR to identify similar patients. The global similarity measures are attributes used to identify similar patients and consisted of prognostic attributes. They were weighted in terms of prognostic importance and choice of treatment, where the weighting represents the relevance of the different attributes. For the local similarity measures, the degree of similarity within each attribute was based on minimal clinically important differences and expert knowledge. The SupportPrim PT’s ability to identify similar patients was assessed by comparing the similarity scores of all patients in the case base with the scores on an established screening tool (the short form Örebro Musculoskeletal Pain Screening Questionnaire [ÖMSPQ]) and an outcome measure (the Musculoskeletal Health Questionnaire [MSK-HQ]) used in musculoskeletal pain. We also assessed the same in a more extensive case base. Results: The original case base contained 105 patients with musculoskeletal pain (mean age 46, SD 15 years; 77/105, 73.3% women). The SupportPrim PT consisted of 29 weighted attributes with local similarities. When comparing the similarity scores for all patients in the case base, one at a time, with the ÖMSPQ and MSK-HQ, the most similar patients had a mean absolute difference from the query patient of 9.3 (95% CI 8.0-10.6) points on the ÖMSPQ and a mean absolute difference of 5.6 (95% CI 4.6-6.6) points on the MSK-HQ. For both ÖMSPQ and MSK-HQ, the absolute score difference increased as the rank of most similar patients decreased. Patients retrieved from a more extensive case base (N=486) had a higher mean similarity score and were slightly more similar to the query patients in ÖMSPQ and MSK-HQ compared with the original smaller case base. Conclusions: This study describes the development of a CBR system, SupportPrim PT, for musculoskeletal pain in primary care. The SupportPrim PT identified similar patients according to an established screening tool and an outcome measure for patients with musculoskeletal pain.
- 10 May 2024
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 8 (1) , e44805
Open AccessDecision Support for Managing Common Musculoskeletal Pain Disorders: Development of a Case-Based Reasoning Application
Background: Common interventions for musculoskeletal pain disorders either lack evidence to support their use or have small to modest or short-term effects. Given the heterogeneity of patients with musculoskeletal pain disorders, treatment guidelines and systematic reviews have limited transferability to clinical practice. A problem-solving method in artificial intelligence, case-based reasoning (CBR), where new problems are solved based on experiences from past similar problems, might offer guidance in such situations. Objective: This study aims to use CBR to build a decision support system for patients with musculoskeletal pain disorders seeking physiotherapy care. This study describes the development of the CBR system SupportPrim PT and demonstrates its ability to identify similar patients. Methods: Data from physiotherapy patients in primary care in Norway were collected to build a case base for SupportPrim PT. We used the local-global principle in CBR to identify similar patients. The global similarity measures are attributes used to identify similar patients and consisted of prognostic attributes. They were weighted in terms of prognostic importance and choice of treatment, where the weighting represents the relevance of the different attributes. For the local similarity measures, the degree of similarity within each attribute was based on minimal clinically important differences and expert knowledge. The SupportPrim PT’s ability to identify similar patients was assessed by comparing the similarity scores of all patients in the case base with the scores on an established screening tool (the short form Örebro Musculoskeletal Pain Screening Questionnaire [ÖMSPQ]) and an outcome measure (the Musculoskeletal Health Questionnaire [MSK-HQ]) used in musculoskeletal pain. We also assessed the same in a more extensive case base. Results: The original case base contained 105 patients with musculoskeletal pain (mean age 46, SD 15 years; 77/105, 73.3% women). The SupportPrim PT consisted of 29 weighted attributes with local similarities. When comparing the similarity scores for all patients in the case base, one at a time, with the ÖMSPQ and MSK-HQ, the most similar patients had a mean absolute difference from the query patient of 9.3 (95% CI 8.0-10.6) points on the ÖMSPQ and a mean absolute difference of 5.6 (95% CI 4.6-6.6) points on the MSK-HQ. For both ÖMSPQ and MSK-HQ, the absolute score difference increased as the rank of most similar patients decreased. Patients retrieved from a more extensive case base (N=486) had a higher mean similarity score and were slightly more similar to the query patients in ÖMSPQ and MSK-HQ compared with the original smaller case base. Conclusions: This study describes the development of a CBR system, SupportPrim PT, for musculoskeletal pain in primary care. The SupportPrim PT identified similar patients according to an established screening tool and an outcome measure for patients with musculoskeletal pain.
- Open Access
- 3 April 2024
- Published by Springer Nature in Research Square
A Microservice-Based Architecture for Clinical Decision Support System for Addressing Non-Specific Musculoskeletal Disorders: The SupportPrim Project
There is a dearth of applied interdisciplinary research on the implementation of a clinical decision support system (CDSS) that employs case-based reasoning (CBR) based on patient data from a subjective questionnaire for non-specific musculoskeletal disorders (MSDs). Furthermore, there are numerous practical obstacles to creating a CDSS system for such a complex and challenging domain, which can impede progress due to several cold-start issues. This applied research introduces a microservice-based backend architecture developed for the interdisciplinary SupportPrim project that mitigates critical real-world challenges while providing a scalable, resilient, and viable CDSS. The implemented CDSS is deployed for randomized controlled trial (RCT) in Norwegian primary care using subjective patient-reported non-specific MSD patient data. The microservice architecture provides scalability, reliability, and a user-centric approach that aligns with the dynamic nature of clinical workflows. The research is based on the applied research methodology while leveraging a design thinking approach to iteratively develop a scalable backend framework that can accommodate the idiosyncrasies of subjective patient data and facilitate the implementation of CBR systems in the CDSS. The results of a laboratory deployment of SupportPrim patient data in the Norwegian primary healthcare setting support the technical competency of the proposed architecture in finding patients with similar non-specific MSDs. Medical researchers have demonstrated the competence of the proposed architecture in the SupportPrim project through iterative experiments carried out by domain experts and the RCT within the Norwegian healthcare system, and clinicians have reported good acceptability and usability of the CDSS. This research might serve as a guide for further investigation and development of an adaptable and scalable patient-centered CDSS employing a CBR system.
- 3 April 2024
- Published by Springer Nature in Research Square
Open AccessA Microservice-Based Architecture for Clinical Decision Support System for Addressing Non-Specific Musculoskeletal Disorders: The SupportPrim Project
There is a dearth of applied interdisciplinary research on the implementation of a clinical decision support system (CDSS) that employs case-based reasoning (CBR) based on patient data from a subjective questionnaire for non-specific musculoskeletal disorders (MSDs). Furthermore, there are numerous practical obstacles to creating a CDSS system for such a complex and challenging domain, which can impede progress due to several cold-start issues. This applied research introduces a microservice-based backend architecture developed for the interdisciplinary SupportPrim project that mitigates critical real-world challenges while providing a scalable, resilient, and viable CDSS. The implemented CDSS is deployed for randomized controlled trial (RCT) in Norwegian primary care using subjective patient-reported non-specific MSD patient data. The microservice architecture provides scalability, reliability, and a user-centric approach that aligns with the dynamic nature of clinical workflows. The research is based on the applied research methodology while leveraging a design thinking approach to iteratively develop a scalable backend framework that can accommodate the idiosyncrasies of subjective patient data and facilitate the implementation of CBR systems in the CDSS. The results of a laboratory deployment of SupportPrim patient data in the Norwegian primary healthcare setting support the technical competency of the proposed architecture in finding patients with similar non-specific MSDs. Medical researchers have demonstrated the competence of the proposed architecture in the SupportPrim project through iterative experiments carried out by domain experts and the RCT within the Norwegian healthcare system, and clinicians have reported good acceptability and usability of the CDSS. This research might serve as a guide for further investigation and development of an adaptable and scalable patient-centered CDSS employing a CBR system.
- Open Access
- 4 December 2022
- Published by JMIR Publications Inc. in JMIR Preprints
Decision Support for Managing Common Musculoskeletal Pain Disorders: Development of a Case-Based Reasoning Application (Preprint)
BACKGROUND Common interventions for musculoskeletal pain disorders either lack evidence to support their use or have small to modest or short-term effects. Given the heterogeneity of patients with musculoskeletal pain disorders, treatment guidelines and systematic reviews have limited transferability to clinical practice. A problem-solving method in artificial intelligence, case-based reasoning (CBR), where new problems are solved based on experiences from past similar problems, might offer guidance in such situations. OBJECTIVE This study aims to use CBR to build a decision support system for patients with musculoskeletal pain disorders seeking physiotherapy care. This study describes the development of the CBR system SupportPrim PT and demonstrates its ability to identify similar patients. METHODS Data from physiotherapy patients in primary care in Norway were collected to build a case base for SupportPrim PT. We used the local-global principle in CBR to identify similar patients. The global similarity measures are attributes used to identify similar patients and consisted of prognostic attributes. They were weighted in terms of prognostic importance and choice of treatment, where the weighting represents the relevance of the different attributes. For the local similarity measures, the degree of similarity within each attribute was based on minimal clinically important differences and expert knowledge. The SupportPrim PT’s ability to identify similar patients was assessed by comparing the similarity scores of all patients in the case base with the scores on an established screening tool (the short form Örebro Musculoskeletal Pain Screening Questionnaire [ÖMSPQ]) and an outcome measure (the Musculoskeletal Health Questionnaire [MSK-HQ]) used in musculoskeletal pain. We also assessed the same in a more extensive case base. RESULTS The original case base contained 105 patients with musculoskeletal pain (mean age 46, SD 15 years; 77/105, 73.3% women). The SupportPrim PT consisted of 29 weighted attributes with local similarities. When comparing the similarity scores for all patients in the case base, one at a time, with the ÖMSPQ and MSK-HQ, the most similar patients had a mean absolute difference from the query patient of 9.3 (95% CI 8.0-10.6) points on the ÖMSPQ and a mean absolute difference of 5.6 (95% CI 4.6-6.6) points on the MSK-HQ. For both ÖMSPQ and MSK-HQ, the absolute score difference increased as the rank of most similar patients decreased. Patients retrieved from a more extensive case base (N=486) had a higher mean similarity score and were slightly more similar to the query patients in ÖMSPQ and MSK-HQ compared with the original smaller case base. CONCLUSIONS This study describes the development of a CBR system, SupportPrim PT, for musculoskeletal pain in primary care. The SupportPrim PT identified similar patients according to an established screening tool and an outcome measure for patients with musculoskeletal pain.
- 4 December 2022
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessDecision Support for Managing Common Musculoskeletal Pain Disorders: Development of a Case-Based Reasoning Application (Preprint)
BACKGROUND Common interventions for musculoskeletal pain disorders either lack evidence to support their use or have small to modest or short-term effects. Given the heterogeneity of patients with musculoskeletal pain disorders, treatment guidelines and systematic reviews have limited transferability to clinical practice. A problem-solving method in artificial intelligence, case-based reasoning (CBR), where new problems are solved based on experiences from past similar problems, might offer guidance in such situations. OBJECTIVE This study aims to use CBR to build a decision support system for patients with musculoskeletal pain disorders seeking physiotherapy care. This study describes the development of the CBR system SupportPrim PT and demonstrates its ability to identify similar patients. METHODS Data from physiotherapy patients in primary care in Norway were collected to build a case base for SupportPrim PT. We used the local-global principle in CBR to identify similar patients. The global similarity measures are attributes used to identify similar patients and consisted of prognostic attributes. They were weighted in terms of prognostic importance and choice of treatment, where the weighting represents the relevance of the different attributes. For the local similarity measures, the degree of similarity within each attribute was based on minimal clinically important differences and expert knowledge. The SupportPrim PT’s ability to identify similar patients was assessed by comparing the similarity scores of all patients in the case base with the scores on an established screening tool (the short form Örebro Musculoskeletal Pain Screening Questionnaire [ÖMSPQ]) and an outcome measure (the Musculoskeletal Health Questionnaire [MSK-HQ]) used in musculoskeletal pain. We also assessed the same in a more extensive case base. RESULTS The original case base contained 105 patients with musculoskeletal pain (mean age 46, SD 15 years; 77/105, 73.3% women). The SupportPrim PT consisted of 29 weighted attributes with local similarities. When comparing the similarity scores for all patients in the case base, one at a time, with the ÖMSPQ and MSK-HQ, the most similar patients had a mean absolute difference from the query patient of 9.3 (95% CI 8.0-10.6) points on the ÖMSPQ and a mean absolute difference of 5.6 (95% CI 4.6-6.6) points on the MSK-HQ. For both ÖMSPQ and MSK-HQ, the absolute score difference increased as the rank of most similar patients decreased. Patients retrieved from a more extensive case base (N=486) had a higher mean similarity score and were slightly more similar to the query patients in ÖMSPQ and MSK-HQ compared with the original smaller case base. CONCLUSIONS This study describes the development of a CBR system, SupportPrim PT, for musculoskeletal pain in primary care. The SupportPrim PT identified similar patients according to an established screening tool and an outcome measure for patients with musculoskeletal pain.
- Open Access
- 6 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 75458-75471
F-CBR: An Architecture for Federated Case-Based Reasoning
Case-based reasoning (CBR) is a problem-solving methodology in artificial intelligence that attempts to solve new problems using past experiences known as cases. Experiences collected in a single case base from an institution or geographical region are seldom sufficient to solve diverse problems, especially in rare situations. Additionally, many institutions do not promote peer-to-peer (p2p) communication or encourage data sharing through such networks to retain autonomy. The paper proposes a federated CBR (F-CBR) architecture to address these challenges. F-CBR enables solving new problems based on similar cases from multiple autonomous CBR systems without p2p communication. We also designed an algorithm to minimize (irrelevant or unsolicited) data sharing in an F-CBR system. We extend the F-CBR design to support institutions with organizational or geographical hierarchies. The F-CBR architecture was implemented and evaluated on two public datasets and a private real-world (non-specific musculoskeletal disorder patient) dataset. The findings demonstrate that the retrieval quality of F-CBR systems is comparable to or better than a single CBR system that persists all the cases on a centralized case base. F-CBR systems address data privacy by incorporating the data minimization principle. We foresee F-CBR as a viable real-world design that can aid in federating legacy CBR systems with minimal or no changes. The CBR systems used in this study are shared on GitHub to support reproducibility.
- 6 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 75458-75471
Open AccessF-CBR: An Architecture for Federated Case-Based Reasoning
Case-based reasoning (CBR) is a problem-solving methodology in artificial intelligence that attempts to solve new problems using past experiences known as cases. Experiences collected in a single case base from an institution or geographical region are seldom sufficient to solve diverse problems, especially in rare situations. Additionally, many institutions do not promote peer-to-peer (p2p) communication or encourage data sharing through such networks to retain autonomy. The paper proposes a federated CBR (F-CBR) architecture to address these challenges. F-CBR enables solving new problems based on similar cases from multiple autonomous CBR systems without p2p communication. We also designed an algorithm to minimize (irrelevant or unsolicited) data sharing in an F-CBR system. We extend the F-CBR design to support institutions with organizational or geographical hierarchies. The F-CBR architecture was implemented and evaluated on two public datasets and a private real-world (non-specific musculoskeletal disorder patient) dataset. The findings demonstrate that the retrieval quality of F-CBR systems is comparable to or better than a single CBR system that persists all the cases on a centralized case base. F-CBR systems address data privacy by incorporating the data minimization principle. We foresee F-CBR as a viable real-world design that can aid in federating legacy CBR systems with minimal or no changes. The CBR systems used in this study are shared on GitHub to support reproducibility.
- 9 August 2019
- Published by Springer Nature
- p. 125-139
A Data-Driven Approach for Determining Weights in Global Similarity Functions
- 9 August 2019
- Published by Springer Nature
- p. 125-139
A Data-Driven Approach for Determining Weights in Global Similarity Functions