Shasta Ihorn
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Shasta Ihorn has a total of 20 co-authors. Here are the top co-authors by number of shared publications:
- Ilmi Yoon
Khoury College of Computer Science, Northeastern University, San Jose, California, USA
4 shared publications - Andrew Taylor Scott
Computer Science and Engineering Department, University of Texas at Arlington, Arlington, Texas, USA
3 shared publications - Alexander Mario Blum
Enrich Your Academics, Emeryville, California, USA
2 shared publications - Gio Jung
Department of Computer Science, San Francisco State University, San Francisco, California, USA
2 shared publications - Juvenal Francisco Barajas
Department of Computer Science, San Francisco State University, San Francisco, California, USA
2 shared publications - Lana Do
Khoury College of Computer Science, Northeastern University, San Jose, California, USA
2 shared publications
Latest Publications
- Open Access
- 24 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-25
Toward Scalable Audio Description Quality Control: A Workflow for Evaluating Human and VLM Raters
- 24 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-25
Open AccessToward Scalable Audio Description Quality Control: A Workflow for Evaluating Human and VLM Raters
- Open Access
- 5 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 166-172
Beyond Lexical Overlap: Validating Semantic Similarity Metrics for LLM-Based Video Caption Augmentation
Large language models (LLMs) can generate synthetic video captions at scale, offering a practical way to enrich datasets that lack multiple human references. However, evaluating the semantic reliability of such captions is challenging, particularly when traditional lexical-overlap metrics (e.g., BLEU, ROUGE, METEOR, CIDEr, SPICE) are sensitive to surface-level wording and often misalign with human judgments. This paper investigates whether sentence embedding models provide more reliable evaluation metrics for LLM-generated video captions. We first compare five embedding models—Sentence-BERT, SimCSE, MPNet, and two GPT-based embeddings—against traditional lexical metrics using 450 caption pairs from VATEX, a benchmark video captioning dataset. Through validation with a linguistic specialist, we find that sentence embedding-based approaches achieve substantially higher agreement with expert judgments using Kendall’s τ correlation. We then used GPT-4o to generate ten synthetic captions per video from VATEX and apply the validated embedding metrics to compare semantic similarities with the human-human caption pairs. We applied the same pipeline to YuWa, a single-reference accessibility video dataset, which demonstrates a real-world use case. Our findings suggest that synthetic captions achieve more consistency in semantic similarity levels compared to independently written human captions. Notably, augmenting YuWa’s single human caption per video with ten LLM-generated captions produces semantic similarity scores matching or surpassing those of VATEX’s ten independently written human captions. This work provides the first expert-validated framework for evaluating LLM-generated video captions and demonstrates a practical pipeline for quality-controlled dataset augmentation in accessibility research.
- 5 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 166-172
Open AccessBeyond Lexical Overlap: Validating Semantic Similarity Metrics for LLM-Based Video Caption Augmentation
Large language models (LLMs) can generate synthetic video captions at scale, offering a practical way to enrich datasets that lack multiple human references. However, evaluating the semantic reliability of such captions is challenging, particularly when traditional lexical-overlap metrics (e.g., BLEU, ROUGE, METEOR, CIDEr, SPICE) are sensitive to surface-level wording and often misalign with human judgments. This paper investigates whether sentence embedding models provide more reliable evaluation metrics for LLM-generated video captions. We first compare five embedding models—Sentence-BERT, SimCSE, MPNet, and two GPT-based embeddings—against traditional lexical metrics using 450 caption pairs from VATEX, a benchmark video captioning dataset. Through validation with a linguistic specialist, we find that sentence embedding-based approaches achieve substantially higher agreement with expert judgments using Kendall’s τ correlation. We then used GPT-4o to generate ten synthetic captions per video from VATEX and apply the validated embedding metrics to compare semantic similarities with the human-human caption pairs. We applied the same pipeline to YuWa, a single-reference accessibility video dataset, which demonstrates a real-world use case. Our findings suggest that synthetic captions achieve more consistency in semantic similarity levels compared to independently written human captions. Notably, augmenting YuWa’s single human caption per video with ten LLM-generated captions produces semantic similarity scores matching or surpassing those of VATEX’s ten independently written human captions. This work provides the first expert-validated framework for evaluating LLM-generated video captions and demonstrates a practical pipeline for quality-controlled dataset augmentation in accessibility research.
- Open Access
- 22 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-17
The Potential of a Visual Dialogue Agent In a Tandem Automated Audio Description System for Videos
- 22 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-17
Open AccessThe Potential of a Visual Dialogue Agent In a Tandem Automated Audio Description System for Videos
- Open Access
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- Vol. 2023, 1-7
Improved Image Caption Rating – Datasets, Game, and Model
How well a caption fits an image can be difficult to assess due to the subjective nature of caption quality. What is a good caption? We investigate this problem by focusing on image-caption ratings and by generating high quality datasets from human feedback with gamification. We validate the datasets by showing a higher level of inter-rater agreement, and by using them to train custom machine learning models to predict new ratings. Our approach outperforms previous metrics – the resulting datasets are more easily learned and are of higher quality than other currently available datasets for image-caption rating.
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- Vol. 2023, 1-7
Open AccessImproved Image Caption Rating – Datasets, Game, and Model
How well a caption fits an image can be difficult to assess due to the subjective nature of caption quality. What is a good caption? We investigate this problem by focusing on image-caption ratings and by generating high quality datasets from human feedback with gamification. We validate the datasets by showing a higher level of inter-rater agreement, and by using them to train custom machine learning models to predict new ratings. Our approach outperforms previous metrics – the resulting datasets are more easily learned and are of higher quality than other currently available datasets for image-caption rating.
- 26 January 2018
- Published by Taylor & Francis in Journal of Educational and Psychological Consultation
- Vol. 28 (3) , 319-341
Teleconsultation to Support the Education of Students with Visual Impairments: A Program Evaluation
Teleconsultation is being increasingly used in schools to support children with disabilities; however, further evaluation of the impact of this practice is needed. This study describes a teleconsultation model used to provide educational support for students with visual impairments being educated in their local school districts and examines the initial acceptability and feasibility of this teleconsultation model. In addition, the current study discusses some of the recommendations for improvement regarding program implementation, with the goal of increasing the ease of use of teleconsultation in schools. Stakeholders reported qualitative and quantitative data indicating that the teleconsultation model is acceptable to and feasible for families and school district staff.
- 26 January 2018
- Published by Taylor & Francis in Journal of Educational and Psychological Consultation
- Vol. 28 (3) , 319-341
Teleconsultation to Support the Education of Students with Visual Impairments: A Program Evaluation
Teleconsultation is being increasingly used in schools to support children with disabilities; however, further evaluation of the impact of this practice is needed. This study describes a teleconsultation model used to provide educational support for students with visual impairments being educated in their local school districts and examines the initial acceptability and feasibility of this teleconsultation model. In addition, the current study discusses some of the recommendations for improvement regarding program implementation, with the goal of increasing the ease of use of teleconsultation in schools. Stakeholders reported qualitative and quantitative data indicating that the teleconsultation model is acceptable to and feasible for families and school district staff.