AHAmal Hashky

Amal Hashky

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Amal Hashky has a total of 12 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Comparison of Text-Based Inputs for Human-in-the-Loop Feedback in Vision–Language Models

    by Reza Shahriari, Amal Hashky, Shivvrat Arya, Tyler Audino, Eric D. Ragan, Vibhav Gogate, Jaime Ruiz

    Human-in-the-loop methods leverage human feedback to enhance machine learning and artificial intelligence. Manual review of outputs can correct errors, identify model weaknesses, or expand labels to broaden model capabilities. Feedback collection methods range from simple flagging of outputs as correct or incorrect to more complex feature-level adjustments or natural language interpretations. This paper presents a user study evaluating changes in user performance over time and explores the trade-off between feedback quality and human effort. We compare four interactive input methods for reviewing and correcting outcomes in object detection and activity recognition in videos. Our findings indicate that while some complex input methods, such as free-text, require more time, the quality and impact of their feedback on model accuracy often surpass those of simpler methods that require less effort. However, more effort does not always lead to better-quality feedback, especially when aiming to improve the model. Our VLM experiments show that the most accurate models were trained using detailed natural language feedback or precise word-level corrections, while simple yes/no judgments also led to solid performance at a much lower annotation cost.

  • Open Access

    A Systematic Review on Human Roles, Solutions, and Methodological Approaches to Address Bias in AI

    by Amal Hashky, Eric Ragan

    People play a significant role in designing, developing, and employing artificial intelligence (AI) systems. They can consider contextual information beyond the scope of AI models, thereby influencing system outcomes. At the same time, people’s choices or biases can introduce problems into the systems. This paradoxical scenario, in which people can both introduce and contribute to relieving the inherited machine bias, demands comprehensive and multidisciplinary approaches involving informed human interventions to improve systems’ performances and reduce their biases. Researchers across various communities have investigated multifaceted methods to reduce and mitigate bias in AI systems. Regardless of the method, humans are always involved in the debiasing method in one way or another, emphasizing the importance of human intervention during AI systems development. In this systematic review, we analyzed 100 peer-reviewed publications from various human-computer interaction (HCI) and machine learning (ML) venues. We discuss their research efforts to minimize data bias and algorithmic bias from three angles. First, we present a comprehensive taxonomy of bias mitigation solutions, analyzing the research methodologies and standard benchmarks for evaluating these solutions, highlighting the human researcher’s role in developing and evaluating solutions to address bias. Next, we identify humans’ roles in alleviating biases and specify how, when, and where their involvement occurs within the AI lifecycle. Finally, we summarize the research focus and methodologies across research disciplines. Our review revealed that, while technical solutions are essential, addressing bias requires a broad perspective that integrates human oversight, ethical frameworks, and interdisciplinary collaboration.


  • User judgment of an AI model is biased by its description: A study in a job interview training context

    by Sharon Lynn Chu, Marcin Karcz, Amal Hashky, Neha Rani, Theodora Chaspari, Winfred Arthur Jr., Eric D. Ragan