Xinyi He
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Xinyi He has a total of 7 co-authors. Here are the top co-authors by number of shared publications:
- Feng Ji
Department of Applied Psychology and Human Development, University of Toronto, Toronto, Canada
3 shared publications Cixiao Wang
1 shared publication- Cixiao Wang
Research Center of Distance Education, Beijing Normal University, Beijing, China
1 shared publication Jia Qi
1 shared publication- Xiaoya Zhang
Department of Family, Youth and Community Sciences, Institute of Food and Agricultural Sciences, University of Florida, Gainesville, USA
1 shared publication - Yuchen Zhang
Department of Applied Psychology and Human Development, University of Toronto, Toronto, Canada
1 shared publication
Latest Publications
- Open Access
- 19 August 2026
- Published by Center for Open Science in PsyArXiv
The Generative Artificial Intelligence Literacy Scale (GAILS): Development, Validation, and Measurement Invariance Across Sex and Occupational Status Groups
Generative Artificial Intelligence (GenAI) tools are rapidly reshaping how people seek information, learn, and work, while also raising concerns about misinformation, bias, privacy, and academic integrity across both educational and workplace contexts. However, many existing AI literacy scales targeted broad AI knowledge rather than GenAI-specific competencies (e.g., prompt formulation, evaluating generated outputs). Emerging GenAI literacy measures have also focused primarily on university students and non-North American samples, limiting their generalizability. We developed and validated a GenAI literacy scale (GAILS) in a diverse North American adult sample (N = 341; Mage = 39.00 years; 38.42% students, 61.58% workforce). The GAILS showed excellent internal consistency (α = 0.973, 95% CI [0.968, 0.978]). Exploratory factor analysis supported a three-factor solution (KMO = 0.959; Bartlett’s χ²(561) = 5784.58, p < .001), and confirmatory factor analysis further supported the model (CFI = 0.967, TLI = 0.965, SRMR = 0.058, RMSEA = 0.087). Items were designed to assess three domains: (a) Adaptive Operational Skills, (b) Responsible GenAI Literacy, and (c) Critical Evaluation & Autonomous Use. Measurement invariance analyses supported scalar invariance across sex (female vs. male) and occupational status (student vs. workforce) groups. Construct validity was supported by positive correlations with GenAI acceptance (r = 0.81) and GenAI trust (r = 0.47). Semantic embedding analysis further supported the conceptual structure of the scale by showing distinct semantic clustering for Responsible GenAI Literacy and meaningful conceptual proximity between Adaptive Operational Skills and Critical Evaluation & Autonomous Use. These results suggest that the GAILS is a psychometrically and conceptually supported tool for assessing GenAI literacy gaps and informing educational, workplace, and policy interventions.
- 19 August 2026
- Published by Center for Open Science in PsyArXiv
Open AccessThe Generative Artificial Intelligence Literacy Scale (GAILS): Development, Validation, and Measurement Invariance Across Sex and Occupational Status Groups
Generative Artificial Intelligence (GenAI) tools are rapidly reshaping how people seek information, learn, and work, while also raising concerns about misinformation, bias, privacy, and academic integrity across both educational and workplace contexts. However, many existing AI literacy scales targeted broad AI knowledge rather than GenAI-specific competencies (e.g., prompt formulation, evaluating generated outputs). Emerging GenAI literacy measures have also focused primarily on university students and non-North American samples, limiting their generalizability. We developed and validated a GenAI literacy scale (GAILS) in a diverse North American adult sample (N = 341; Mage = 39.00 years; 38.42% students, 61.58% workforce). The GAILS showed excellent internal consistency (α = 0.973, 95% CI [0.968, 0.978]). Exploratory factor analysis supported a three-factor solution (KMO = 0.959; Bartlett’s χ²(561) = 5784.58, p < .001), and confirmatory factor analysis further supported the model (CFI = 0.967, TLI = 0.965, SRMR = 0.058, RMSEA = 0.087). Items were designed to assess three domains: (a) Adaptive Operational Skills, (b) Responsible GenAI Literacy, and (c) Critical Evaluation & Autonomous Use. Measurement invariance analyses supported scalar invariance across sex (female vs. male) and occupational status (student vs. workforce) groups. Construct validity was supported by positive correlations with GenAI acceptance (r = 0.81) and GenAI trust (r = 0.47). Semantic embedding analysis further supported the conceptual structure of the scale by showing distinct semantic clustering for Responsible GenAI Literacy and meaningful conceptual proximity between Adaptive Operational Skills and Critical Evaluation & Autonomous Use. These results suggest that the GAILS is a psychometrically and conceptually supported tool for assessing GenAI literacy gaps and informing educational, workplace, and policy interventions.
- Open Access
- 5 July 2026
- Published by Center for Open Science in PsyArXiv
Clarifying the Conceptual Landscape in AI Literacy Measurement: A Large Language Model Based Approach
The rapid proliferation of AI literacy instruments has expanded the scope of the field, while introducing diversity in definitions, dimensional structures, and item operationalizations, which complicates cross-instrument comparison and cumulative interpretation. To support a clearer view of this measurement landscape, this study employs a large language model (LLM) based semantic analysis to map the structure of AI literacy content domain across instruments. Drawing on 11 rigorously reviewed AI literacy scales comprising 55 constructs and 272 items, we map construct definitions and item texts into a shared semantic space using transformer-based embeddings. The analysis first examines the coherence and distinctiveness of AI literacy constructs across instruments, and then explores patterns of alignment and divergence between construct labels and their item operationalizations. The results indicate a semantically consolidated core centered on cognitive and technical dimensions of AI literacy, alongside more weakly integrated affective and collaborative components. In addition, patterns of semantic convergence and divergence are observed. Constructs with different labels (e.g., Behavioral Commitment and AI Learning) show similarity in their item operationalizations, whereas other constructs sharing similar labels (e.g., Technical Proficiency and Technical Understanding) diverge in the competencies emphasized by their items. Methodologically, this filed-level mapping provides a foundation for more rigorous instrument development and supports cumulative measurement development. Our results highlight the importance of using clearer and more internally consistent operationalizations to support cumulative progress in measurement development and to enhance the educational applicability of AI literacy frameworks.
- 5 July 2026
- Published by Center for Open Science in PsyArXiv
Open AccessClarifying the Conceptual Landscape in AI Literacy Measurement: A Large Language Model Based Approach
The rapid proliferation of AI literacy instruments has expanded the scope of the field, while introducing diversity in definitions, dimensional structures, and item operationalizations, which complicates cross-instrument comparison and cumulative interpretation. To support a clearer view of this measurement landscape, this study employs a large language model (LLM) based semantic analysis to map the structure of AI literacy content domain across instruments. Drawing on 11 rigorously reviewed AI literacy scales comprising 55 constructs and 272 items, we map construct definitions and item texts into a shared semantic space using transformer-based embeddings. The analysis first examines the coherence and distinctiveness of AI literacy constructs across instruments, and then explores patterns of alignment and divergence between construct labels and their item operationalizations. The results indicate a semantically consolidated core centered on cognitive and technical dimensions of AI literacy, alongside more weakly integrated affective and collaborative components. In addition, patterns of semantic convergence and divergence are observed. Constructs with different labels (e.g., Behavioral Commitment and AI Learning) show similarity in their item operationalizations, whereas other constructs sharing similar labels (e.g., Technical Proficiency and Technical Understanding) diverge in the competencies emphasized by their items. Methodologically, this filed-level mapping provides a foundation for more rigorous instrument development and supports cumulative measurement development. Our results highlight the importance of using clearer and more internally consistent operationalizations to support cumulative progress in measurement development and to enhance the educational applicability of AI literacy frameworks.
- 28 June 2026
- Published by Springer Nature
- p. 361-369
A Generator-Aligner Pipeline for LLM-Based Situational Judgment Test Generation
- 28 June 2026
- Published by Springer Nature
- p. 361-369
A Generator-Aligner Pipeline for LLM-Based Situational Judgment Test Generation