Qiao Lin
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Qiao Lin has a total of 8 co-authors. Here are the top co-authors by number of shared publications:
- Yoon Soo Park
Department of Medical Education, University of Illinois at Chicago College of Medicine, Chicago, Illinois
2 shared publications - James A. Swartz
Jane Addams College of Social Work, University of Illinois Chicago, Chicago
1 shared publication - Kuan Xing
University of Tennessee Health Science Center
1 shared publication Roxana Hadad
1 shared publicationXiaodan Tang
1 shared publication- Xiaoming Zhai
University of Georgia
1 shared publication
Latest Publications
- 11 December 2022
- Published by Taylor & Francis in Multivariate Behavioral Research
- Vol. 58 (4) , 843-858
Evaluating Modes of Observations Using Hierarchical Signal Detection Rater Models
Scoring of performance can be based on different modes of observation, which can include live and videotaped observations. Although live observations have been the traditional format of measuring examinee performance in education and in healthcare, videotaped observations provide educators and testing agencies the promise of unbiased and standardized evaluations, offering practical solutions to limitations of real-time scoring. This study proposes a measurement model taking into account different modes of observation, using an extension of the hierarchical rater model based on signal detection theory (HRM-SDT). A hierarchical rater model is motivated by the nested structure of scores assigned by raters - scores assigned by raters become indicators of performance quality, which in turn become indicators of examinee ability. This study extends the hierarchical structure of the scoring process to include modes of observation, which serves as an intermediary level between the latent categorical indicator of performance quality and examinee ability, forming a three-level HRM-SDT. Analyses based on real-world data showed differences in the quality of scores from live observations and videotaped recordings. Compared to the traditional HRM-SDT, the overall model fit improved when including modes of observation. Simulations using different sample sizes and conditions provide implications for uses of this model.
- 11 December 2022
- Published by Taylor & Francis in Multivariate Behavioral Research
- Vol. 58 (4) , 843-858
Evaluating Modes of Observations Using Hierarchical Signal Detection Rater Models
Scoring of performance can be based on different modes of observation, which can include live and videotaped observations. Although live observations have been the traditional format of measuring examinee performance in education and in healthcare, videotaped observations provide educators and testing agencies the promise of unbiased and standardized evaluations, offering practical solutions to limitations of real-time scoring. This study proposes a measurement model taking into account different modes of observation, using an extension of the hierarchical rater model based on signal detection theory (HRM-SDT). A hierarchical rater model is motivated by the nested structure of scores assigned by raters - scores assigned by raters become indicators of performance quality, which in turn become indicators of examinee ability. This study extends the hierarchical structure of the scoring process to include modes of observation, which serves as an intermediary level between the latent categorical indicator of performance quality and examinee ability, forming a three-level HRM-SDT. Analyses based on real-world data showed differences in the quality of scores from live observations and videotaped recordings. Compared to the traditional HRM-SDT, the overall model fit improved when including modes of observation. Simulations using different sample sizes and conditions provide implications for uses of this model.
- Open Access
- 14 October 2022
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 17 (10) , e0271418
A measurement invariance analysis of selected Opioid Overdose Knowledge Scale (OOKS) items among bystanders and first responders
The Opioid Overdose Knowledge Scale (OOKS) is widely used as an adjunct to opioid education and naloxone distribution (OEND) for assessing pre- and post-training knowledge. However, the extent to which the OOKS performs comparably for bystander and first responder groups has not been well determined. We used exploratory structural equation modeling (ESEM) to assess the measurement invariance of an OOKS item subset when used as an OEND training pre-test. We used secondary analysis of pre-test data collected from 446 first responders and 1,349 bystanders (N = 1,795) attending OEND trainings conducted by two county public health departments. Twenty-four items were selected by practitioner/trainer consensus from the original 45-item OOKS instrument with an additional 2 removed owing to low response variation. We used exploratory factor analysis (EFA) followed by ESEM to identify a factor structure, which we assessed for configural, metric, and scalar measurement invariance by participant group using the 22 dichotomous items (correct/incorrect) as factor indicators. EFA identified a 3-factor model consisting of items assessing: basic overdose risk information, signs of an overdose, and rescue procedures/advanced overdose risk information. Model fit by ESEM estimation versus confirmatory factor analysis showed the ESEM model afforded a better fit. Measurement invariance analyses indicated the 3-factor model fit the data across all levels of invariance per standard fit statistic metrics. The reduced set of 22 OOKS items appears to offer comparable measurement of pre-training knowledge on opioid overdose risks, signs of an overdose, and rescue procedures for both bystanders and first responders.
- 14 October 2022
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 17 (10) , e0271418
Open AccessA measurement invariance analysis of selected Opioid Overdose Knowledge Scale (OOKS) items among bystanders and first responders
The Opioid Overdose Knowledge Scale (OOKS) is widely used as an adjunct to opioid education and naloxone distribution (OEND) for assessing pre- and post-training knowledge. However, the extent to which the OOKS performs comparably for bystander and first responder groups has not been well determined. We used exploratory structural equation modeling (ESEM) to assess the measurement invariance of an OOKS item subset when used as an OEND training pre-test. We used secondary analysis of pre-test data collected from 446 first responders and 1,349 bystanders (N = 1,795) attending OEND trainings conducted by two county public health departments. Twenty-four items were selected by practitioner/trainer consensus from the original 45-item OOKS instrument with an additional 2 removed owing to low response variation. We used exploratory factor analysis (EFA) followed by ESEM to identify a factor structure, which we assessed for configural, metric, and scalar measurement invariance by participant group using the 22 dichotomous items (correct/incorrect) as factor indicators. EFA identified a 3-factor model consisting of items assessing: basic overdose risk information, signs of an overdose, and rescue procedures/advanced overdose risk information. Model fit by ESEM estimation versus confirmatory factor analysis showed the ESEM model afforded a better fit. Measurement invariance analyses indicated the 3-factor model fit the data across all levels of invariance per standard fit statistic metrics. The reduced set of 22 OOKS items appears to offer comparable measurement of pre-training knowledge on opioid overdose risks, signs of an overdose, and rescue procedures for both bystanders and first responders.
- Top Cited Papers
- 1 April 2020
- Published by Elsevier in Computers & Education
- Vol. 148
Assessing computational thinking: A systematic review of empirical studies
- 1 April 2020
- Published by Elsevier in Computers & Education
- Vol. 148
Top Cited PapersAssessing computational thinking: A systematic review of empirical studies
- 25 November 2019
- Published by Cambridge University Press (CUP) in Psychometrika
- Vol. 85 (1) , 247-250
Review of Advances in Latent Class Analysis - G. R. Hancock, J. R. Harring & G. B. Macready (2019). Advances in Latent Class Analysis: A Festchrift in Honor of C. Mitchell Dayton. Charlotte, NC: Information Age Publishing, Inc. 257 p. US$39.09. ISBN: 9781641135610.
- 25 November 2019
- Published by Cambridge University Press (CUP) in Psychometrika
- Vol. 85 (1) , 247-250
Review of Advances in Latent Class Analysis - G. R. Hancock, J. R. Harring & G. B. Macready (2019). Advances in Latent Class Analysis: A Festchrift in Honor of C. Mitchell Dayton. Charlotte, NC: Information Age Publishing, Inc. 257 p. US$39.09. ISBN: 9781641135610.