Ehsan Jahangirzadeh Soure
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Ehsan Jahangirzadeh Soure has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Emily Kuang
Electrical Engineering and Computer Science, York University, Toronto, Ontario, CANADA
2 shared publications - Kristen Shinohara
School of Information, Rochester Institute of Technology, Rochester, New York, USA
2 shared publications - Mingming Fan
Computational Media and Arts Thrust, The Hong Kong University of Science and Technology (Guangzhou)
2 shared publications - Jian Zhao
School of Computer Science, University of Waterloo, Waterloo, Ontario, Canada
1 shared publication - Luyao Shen
Computational Media and Arts, The Hong Kong University of Science and Technology
1 shared publication - Nitesh Goyal
Google Research, New York, New York, USA
1 shared publication
Latest Publications
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-26
“It Became My Buddy, But I’m Not Afraid to Disagree”: A Multi-Session Study of UX Evaluators Collaborating with Conversational AI Assistants
AI-assisted usability analysis can potentially reduce the time and effort of finding usability problems, yet little is known about how AI’s perceived expertise influences evaluators’ analytic strategies and perceptions over time. We ran a within-subjects, five-session study (six hours per participant) with 12 professional UX evaluators who worked with two conversational assistants designed to appear novice- or expert-like (differing in suggestion quantity and response accuracy). We logged behavioral measures (number of passes, suggestion acceptance rate), collected subjective ratings (trust, perceived efficiency), and conducted semi-structured interviews. Participants experienced an initial novelty effect and a subsequent dip in trust that recovered over time. Their efficiency improved as they shifted from a two-pass to a one-pass video inspection approach. Evaluators ultimately rated the experienced CA as significantly more efficient, trustworthy, and comprehensive, despite not perceiving expertise differences early on. We conclude with design implications for adapting AI expertise to enable calibrated human-AI collaboration.
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-26
Open Access“It Became My Buddy, But I’m Not Afraid to Disagree”: A Multi-Session Study of UX Evaluators Collaborating with Conversational AI Assistants
AI-assisted usability analysis can potentially reduce the time and effort of finding usability problems, yet little is known about how AI’s perceived expertise influences evaluators’ analytic strategies and perceptions over time. We ran a within-subjects, five-session study (six hours per participant) with 12 professional UX evaluators who worked with two conversational assistants designed to appear novice- or expert-like (differing in suggestion quantity and response accuracy). We logged behavioral measures (number of passes, suggestion acceptance rate), collected subjective ratings (trust, perceived efficiency), and conducted semi-structured interviews. Participants experienced an initial novelty effect and a subsequent dip in trust that recovered over time. Their efficiency improved as they shifted from a two-pass to a one-pass video inspection approach. Evaluators ultimately rated the experienced CA as significantly more efficient, trustworthy, and comprehensive, despite not perceiving expertise differences early on. We conclude with design implications for adapting AI expertise to enable calibrated human-AI collaboration.
- Open Access
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Collaboration with Conversational AI Assistants for UX Evaluation: Questions and How to Ask them (Voice vs. Text)
AI is promising in assisting UX evaluators with analyzing usability tests, but its judgments are typically presented as non-interactive visualizations. Evaluators may have questions about test recordings, but have no way of asking them. Interactive conversational assistants provide a Q&A dynamic that may improve analysis efficiency and evaluator autonomy. To understand the full range of analysis-related questions, we conducted a Wizard-of-Oz design probe study with 20 participants who interacted with simulated AI assistants via text or voice. We found that participants asked for five categories of information: user actions, user mental model, help from the AI assistant, product and task information, and user demographics. Those who used the text assistant asked more questions, but the question lengths were similar. The text assistant was perceived as significantly more efficient, but both were rated equally in satisfaction and trust. We also provide design considerations for future conversational AI assistants for UX evaluation.
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Open AccessCollaboration with Conversational AI Assistants for UX Evaluation: Questions and How to Ask them (Voice vs. Text)
AI is promising in assisting UX evaluators with analyzing usability tests, but its judgments are typically presented as non-interactive visualizations. Evaluators may have questions about test recordings, but have no way of asking them. Interactive conversational assistants provide a Q&A dynamic that may improve analysis efficiency and evaluator autonomy. To understand the full range of analysis-related questions, we conducted a Wizard-of-Oz design probe study with 20 participants who interacted with simulated AI assistants via text or voice. We found that participants asked for five categories of information: user actions, user mental model, help from the AI assistant, product and task information, and user demographics. Those who used the text assistant asked more questions, but the question lengths were similar. The text assistant was perceived as significantly more efficient, but both were rated equally in satisfaction and trust. We also provide design considerations for future conversational AI assistants for UX evaluation.