Priya Kannan
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Priya Kannan has a total of 20 co-authors. Here are the top co-authors by number of shared publications:
Adrienne Sgammato
Educational Testing Service; Princeton NJ
3 shared publications- Diego Zapata-Rivera
ETS Research Institute
2 shared publications - Richard J. Tannenbaum
Educational Testing Service Princeton NJ
2 shared publications - Aleata Hubbard Cheuoua
WestEd, San Francisco, CA, USA
1 shared publication Andrew D. Bryant
Educational Testing Service Princeton NJ USA
1 shared publication- Daniel Murphy
WestEd
1 shared publication
Latest Publications
- Open Access
- 7 August 2023
- Published by Association for Computing Machinery (ACM)
- p. 256-269
The Development and Validation of a Survey to Predict Computing Career Intentions
- 7 August 2023
- Published by Association for Computing Machinery (ACM)
- p. 256-269
Open AccessThe Development and Validation of a Survey to Predict Computing Career Intentions
- Open Access
- 3 May 2021
- Published by Wiley in ETS Research Report Series
- Vol. 2021 (1) , 1-39
Identifying Teachers' Needs for Results From Interim Unit Assessments
Interim assessments have been defined variously in different contexts and can be used for predictive purposes or instructional purposes. In this paper, we present results from a study where we evaluated reporting needs for interim assessments designed for instructional purposes and intended to be used at the end of defined curriculum units. Results from such unit assessments should help teachers determine gaps in student understanding and inform ongoing instructional decision‐making. Our goal was to determine if learning progressions (LPs) could serve as the cognitive lens through which teachers can evaluate how their students' understanding of key constructs improves through periodic unit assessments. Therefore, we used the LP framework in mathematics and the key practices (KP) framework for English language arts (ELA) to design preliminary teacher report mock‐ups for these unit assessments. Within a utilization‐oriented evaluation framework, we conducted six needs‐assessment focus groups with elementary and middle school mathematics (n = 12) and ELA (n = 11) teachers to specifically evaluate the extent to which they find results presented within the LP and KP frameworks understandable and useful for their instructional practice. Results from the focus groups show teachers' overall needs for types of information sought from unit assessment reports, the extent to which teachers are familiar with the LP and KP frameworks, their interpretations (including confusions) of the information presented in the preliminary mock‐ups, and their additional needs for reports from unit assessments to be instructionally useful.
- 3 May 2021
- Published by Wiley in ETS Research Report Series
- Vol. 2021 (1) , 1-39
Open AccessIdentifying Teachers' Needs for Results From Interim Unit Assessments
Interim assessments have been defined variously in different contexts and can be used for predictive purposes or instructional purposes. In this paper, we present results from a study where we evaluated reporting needs for interim assessments designed for instructional purposes and intended to be used at the end of defined curriculum units. Results from such unit assessments should help teachers determine gaps in student understanding and inform ongoing instructional decision‐making. Our goal was to determine if learning progressions (LPs) could serve as the cognitive lens through which teachers can evaluate how their students' understanding of key constructs improves through periodic unit assessments. Therefore, we used the LP framework in mathematics and the key practices (KP) framework for English language arts (ELA) to design preliminary teacher report mock‐ups for these unit assessments. Within a utilization‐oriented evaluation framework, we conducted six needs‐assessment focus groups with elementary and middle school mathematics (n = 12) and ELA (n = 11) teachers to specifically evaluate the extent to which they find results presented within the LP and KP frameworks understandable and useful for their instructional practice. Results from the focus groups show teachers' overall needs for types of information sought from unit assessment reports, the extent to which teachers are familiar with the LP and KP frameworks, their interpretations (including confusions) of the information presented in the preliminary mock‐ups, and their additional needs for reports from unit assessments to be instructionally useful.
- Open Access
- 12 November 2018
- Published by Wiley in ETS Research Report Series
- Vol. 2018 (1) , 1-17
Anchored Graphical Representations: A Graphical Alternative to Traditional Just Qualified Candidate Descriptors for Licensure Tests
- 12 November 2018
- Published by Wiley in ETS Research Report Series
- Vol. 2018 (1) , 1-17
Open AccessAnchored Graphical Representations: A Graphical Alternative to Traditional Just Qualified Candidate Descriptors for Licensure Tests
- Open Access
- 16 August 2018
- Published by Taylor & Francis
- p. 63-73
Communicating Measurement Error Information to Teachers and Parents
In this chapter, we discuss current research and practices in score reporting for credentialing and admissions testing programs. The different types of information presented in score reports are described, and we offer perspectives on key validity issues that focus on facilitating proper interpretations of examinees’ performance. Our review emphasizes the importance of studying the needs of different stakeholder groups and developing score reports and interpretive materials that suit their needs. Score reports for credentialing and admissions tests should facilitate proper interpretation of examinees’ performance so the intended purposes of the tests can be fulfilled, and any potential negative consequences can be minimized. The degree to which score reports are correctly interpreted should be a standard part of developing a validity argument for credentialing and admissions testing programs.
- 16 August 2018
- Published by Taylor & Francis
- p. 63-73
Open AccessCommunicating Measurement Error Information to Teachers and Parents
In this chapter, we discuss current research and practices in score reporting for credentialing and admissions testing programs. The different types of information presented in score reports are described, and we offer perspectives on key validity issues that focus on facilitating proper interpretations of examinees’ performance. Our review emphasizes the importance of studying the needs of different stakeholder groups and developing score reports and interpretive materials that suit their needs. Score reports for credentialing and admissions tests should facilitate proper interpretation of examinees’ performance so the intended purposes of the tests can be fulfilled, and any potential negative consequences can be minimized. The degree to which score reports are correctly interpreted should be a standard part of developing a validity argument for credentialing and admissions testing programs.
- 29 May 2018
- Published by Taylor & Francis in Educational Assessment
- Vol. 23 (3) , 173-194
Interpretation of Score Reports by Diverse Subgroups of Parents
The degree to which diverse score users can understand and consume information presented in score reports dictates whether they are able to draw reasonable conclusions. The goal of this study was to understand how parents (a particularly understudied and heterogeneous stakeholder population) make interpretations from a hypothetical interactive score report. We used cognitive laboratories to evaluate how 35 parents from diverse educational and language proficiency backgrounds make sense of the information presented in hypothetical K-12 score reports. Results from this study demonstrate the diversity in the levels of comprehension across the assessed subgroups of parents, and highlight the need for and importance of additional support materials that can help parents understand and make sense of the information presented in score reports. Nevertheless, due to the hypothetical nature of the score report mockup evaluated and the small sample sizes, these results should be substantiated with additional research.
- 29 May 2018
- Published by Taylor & Francis in Educational Assessment
- Vol. 23 (3) , 173-194
Interpretation of Score Reports by Diverse Subgroups of Parents
The degree to which diverse score users can understand and consume information presented in score reports dictates whether they are able to draw reasonable conclusions. The goal of this study was to understand how parents (a particularly understudied and heterogeneous stakeholder population) make interpretations from a hypothetical interactive score report. We used cognitive laboratories to evaluate how 35 parents from diverse educational and language proficiency backgrounds make sense of the information presented in hypothetical K-12 score reports. Results from this study demonstrate the diversity in the levels of comprehension across the assessed subgroups of parents, and highlight the need for and importance of additional support materials that can help parents understand and make sense of the information presented in score reports. Nevertheless, due to the hypothetical nature of the score report mockup evaluated and the small sample sizes, these results should be substantiated with additional research.
- 7 July 2017
- Published by Wiley in ETS Research Report Series
- Vol. 2017 (1) , 1-17
Articulation of Cut Scores in the Context of the Next-Generation Assessments
- 7 July 2017
- Published by Wiley in ETS Research Report Series
- Vol. 2017 (1) , 1-17
Articulation of Cut Scores in the Context of the Next-Generation Assessments
- Open Access
- 8 August 2016
- Published by Wiley in ETS Research Report Series
- Vol. 2016 (2) , 1-20
Vertical Articulation of Cut Scores Across the Grades: Current Practices and Methodological Implications in the Light of the Next Generation of K-12 Assessments
- 8 August 2016
- Published by Wiley in ETS Research Report Series
- Vol. 2016 (2) , 1-20
Open AccessVertical Articulation of Cut Scores Across the Grades: Current Practices and Methodological Implications in the Light of the Next Generation of K-12 Assessments
- 27 July 2015
- Published by Taylor & Francis in Applied Measurement in Education
- Vol. 28 (4) , 292-307
Evaluating the Operational Feasibility of Using Subsets of Items to Recommend Minimal Competency Cut Scores
Establishing cut scores using the Angoff method requires panelists to evaluate every item on a test and make a probability judgment. This can be time-consuming when there are large numbers of items on the test. Previous research using resampling studies suggest that it is possible to recommend stable Angoff-based cut score estimates using a content-stratified subset of ˜45 items. Recommendations from earlier work were directly applied in this study in two operational standard-setting meetings. Angoff cut scores from two panels of raters were collected at each study, wherein one panel established the cut score based on the entire test, and another comparable panel first used a proportionally stratified subset of 45 items, and subsequently used the entire test in recommending the cut scores. The cut scores recommended for the subset of items were compared to the cut scores recommended based on the entire test for the same panel, and a comparable independent panel. Results from both studies suggest that cut scores recommended using a subset of items are comparable (i.e., within one standard error) to the cut score estimates from the full test.
- 27 July 2015
- Published by Taylor & Francis in Applied Measurement in Education
- Vol. 28 (4) , 292-307
Evaluating the Operational Feasibility of Using Subsets of Items to Recommend Minimal Competency Cut Scores
Establishing cut scores using the Angoff method requires panelists to evaluate every item on a test and make a probability judgment. This can be time-consuming when there are large numbers of items on the test. Previous research using resampling studies suggest that it is possible to recommend stable Angoff-based cut score estimates using a content-stratified subset of ˜45 items. Recommendations from earlier work were directly applied in this study in two operational standard-setting meetings. Angoff cut scores from two panels of raters were collected at each study, wherein one panel established the cut score based on the entire test, and another comparable panel first used a proportionally stratified subset of 45 items, and subsequently used the entire test in recommending the cut scores. The cut scores recommended for the subset of items were compared to the cut scores recommended based on the entire test for the same panel, and a comparable independent panel. Results from both studies suggest that cut scores recommended using a subset of items are comparable (i.e., within one standard error) to the cut score estimates from the full test.
- 5 June 2015
- Published by Taylor & Francis in Applied Measurement in Education
- Vol. 28 (3) , 169-186
Evaluating the Consistency of Angoff-Based Cut Scores Using Subsets of Items Within a Generalizability Theory Framework
- 5 June 2015
- Published by Taylor & Francis in Applied Measurement in Education
- Vol. 28 (3) , 169-186
Evaluating the Consistency of Angoff-Based Cut Scores Using Subsets of Items Within a Generalizability Theory Framework
- 2 January 2015
- Published by Taylor & Francis in Educational Assessment
- Vol. 20 (1) , 66-78
Consistency of Angoff-Based Standard-Setting Judgments: Are Item Judgments and Passing Scores Replicable Across Different Panels of Experts?
Angoff-based standard setting is widely used, especially for high-stakes licensure assessments. Nonetheless, some critics have claimed that the judgment task is too cognitively complex for panelists, whereas others have explicitly challenged the consistency in (replicability of) standard-setting outcomes. Evidence of consistency in item judgments and passing scores is necessary to justify using the passing scores for consequential decisions. Few studies, however, have directly evaluated consistency across different standard-setting panels. The purpose of this study was to investigate consistency of Angoff-based standard-setting judgments and passing scores across 9 different educator licensure assessments. Two independent, multistate panels of educators were formed to recommend the passing score for each assessment, with each panel engaging in 2 rounds of judgments. Multiple measures of consistency were applied to each round of judgments. The results provide positive evidence of the consistency in judgments and passing scores.
- 2 January 2015
- Published by Taylor & Francis in Educational Assessment
- Vol. 20 (1) , 66-78
Consistency of Angoff-Based Standard-Setting Judgments: Are Item Judgments and Passing Scores Replicable Across Different Panels of Experts?
Angoff-based standard setting is widely used, especially for high-stakes licensure assessments. Nonetheless, some critics have claimed that the judgment task is too cognitively complex for panelists, whereas others have explicitly challenged the consistency in (replicability of) standard-setting outcomes. Evidence of consistency in item judgments and passing scores is necessary to justify using the passing scores for consequential decisions. Few studies, however, have directly evaluated consistency across different standard-setting panels. The purpose of this study was to investigate consistency of Angoff-based standard-setting judgments and passing scores across 9 different educator licensure assessments. Two independent, multistate panels of educators were formed to recommend the passing score for each assessment, with each panel engaging in 2 rounds of judgments. Multiple measures of consistency were applied to each round of judgments. The results provide positive evidence of the consistency in judgments and passing scores.