Evaluating the Evaluator: LLM Evaluators for Patient-Facing AI Agents
Open Access
- 4 July 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Abstract
No abstract availableThis publication has 18 references indexed in Scilit:
- Evaluating clinical AI summaries with large language models as judgesnpj Digital Medicine, 2025
- Beyond Decision Making: Considering Collaboration and Agency in the Design of AI-Based Decision-Support Systems for Fast-Response Medical TeamsProceedings of the ACM on Human-Computer Interaction, 2025
- LLM-as-a-Judge for Privacy Evaluation? Exploring the Alignment of Human and LLM Perceptions of Privacy in Textual Data2025
- HealthQ: Unveiling questioning capabilities of LLM chains in healthcare conversationsSmart Health, 2025
- Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Tasks2025
- Development of a GenAI-Powered Hypertension Management Assistant: Early Development Phases and Architectural Design2024
- Developing and Scaling Remote Patient Monitoring Capacity in Ambulatory PracticeNEJM Catalyst, 2024
- Infrastructuring Telehealth in (In)Formal Patient-Doctor ContextsProceedings of the ACM on Human-Computer Interaction, 2021
- Restructuring Human Infrastructure2015
- On Articulation and Localization - Some Sociotechnical Issues of Design, Implementation, and Evaluation of Knowledge Based SystemsLecture Notes in Computer Science, 2001