Hossein Salemi
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Hossein Salemi has a total of 8 co-authors. Here are the top co-authors by number of shared publications:
- Hemant Purohit
George Mason University, Fairfax, VA, USA
3 shared publications - Amanda Lee Hughes
Brigham Young University
1 shared publication - Jitin Krishnan
Snap Inc., Bellevue, WA, USA
1 shared publication - Steve Peterson
Montgomery County Community Emergency Response Team, Gaithersburg, MD, USA
1 shared publication - Sungsoo Ray Hong
Information Sciences and Technology, George Mason University, Fairfax, Virginia, USA
1 shared publication - Tarin Sultana Sharika
George Mason University
1 shared publication
Latest Publications
- 14 September 2024
- Published by Springer Nature
- p. 236-245
Integrated Content-Graph Analysis to Characterize Social Media Conversations During Disaster Evacuations
- 14 September 2024
- Published by Springer Nature
- p. 236-245
Integrated Content-Graph Analysis to Characterize Social Media Conversations During Disaster Evacuations
- Open Access
- 18 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 405-418
Closing the Knowledge Gap in Designing Data Annotation Interfaces for AI-powered Disaster Management Analytic Systems
Data annotation interfaces predominantly leverage ground truth labels to guide annotators toward accurate responses. With the growing adoption of Artificial Intelligence (AI) in domain-specific professional tasks, it has become increasingly important to help beginning annotators identify how their early-stage knowledge can lead to inaccurate answers, which in turn, helps to ensure quality annotations at scale. To investigate this issue, we conducted a formative study involving eight individuals from the field of disaster management, each possessing varying levels of expertise. The goal was to understand the prevalent factors contributing to disagreements among annotators when classifying Twitter messages related to disasters and to analyze their respective responses. Our analysis identified two primary causes of disagreement between expert and beginner annotators: 1) a lack of contextual knowledge or uncertainty about the situation, and 2) the absence of visual or supplementary cues. Based on these findings, we designed a Context interface, which generates aids that help beginners identify potential mistakes and provide the hidden context of the presented tweet. The summative study compares Context design with two widely used designs in data annotation UI, Highlight and Reasoning-based interfaces. We found significant differences between these designs in terms of attitudinal and behavioral data. We conclude with implications for designing future interfaces aiming at closing the knowledge gap among annotators.
- 18 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 405-418
Open AccessClosing the Knowledge Gap in Designing Data Annotation Interfaces for AI-powered Disaster Management Analytic Systems
Data annotation interfaces predominantly leverage ground truth labels to guide annotators toward accurate responses. With the growing adoption of Artificial Intelligence (AI) in domain-specific professional tasks, it has become increasingly important to help beginning annotators identify how their early-stage knowledge can lead to inaccurate answers, which in turn, helps to ensure quality annotations at scale. To investigate this issue, we conducted a formative study involving eight individuals from the field of disaster management, each possessing varying levels of expertise. The goal was to understand the prevalent factors contributing to disagreements among annotators when classifying Twitter messages related to disasters and to analyze their respective responses. Our analysis identified two primary causes of disagreement between expert and beginner annotators: 1) a lack of contextual knowledge or uncertainty about the situation, and 2) the absence of visual or supplementary cues. Based on these findings, we designed a Context interface, which generates aids that help beginners identify potential mistakes and provide the hidden context of the presented tweet. The summative study compares Context design with two widely used designs in data annotation UI, Highlight and Reasoning-based interfaces. We found significant differences between these designs in terms of attitudinal and behavioral data. We conclude with implications for designing future interfaces aiming at closing the knowledge gap among annotators.