Janice Kooken
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Janice Kooken has a total of 31 co-authors. Here are the top co-authors by number of shared publications:
D. Betsy McCoach
Department of Educational Psychology, University of Connecticut, Storrs, CT, USA
4 shared publications- Faith G. Miller
Department of Educational Psychology, University of Minnesota
4 shared publications - Megan E. Welsh
School of Education, University of California, Davis, CA 95616, USA
3 shared publications - Sandra M. Chafouleas
University of Connecticut, Storrs, USA
3 shared publications - T. Chris Riley-Tillman
Department of Educational, School, and Counseling Psychology
3 shared publications Megan E. Welsh
School of Education, University of California, Davis
2 shared publications
Latest Publications
- 5 February 2021
- Published by Springer Nature in Metacognition and Learning
- Vol. 16 (2) , 367-405
Simulating the dynamics of self-regulation, emotion, grit, and student performance in cyber-learning environments
This research presents the results of development and validation of the Cyclical Self-Regulated Learning (SRL) Simulation Model, a model of student cognitive and metacognitive experiences learning mathematics within an intelligent tutoring system (ITS). Patterned after Zimmerman and Moylan’s (2009) Cyclical SRL Model, the Simulation Model depicts a feedback cycle connecting forethought, performance and self-reflection, with emotion hypothesized as a key determinant of student learning. A mathematical model was developed in steps, using data collected from students during their sessions within the ITS, developing solutions using structural equation modeling, and using these coefficients to calibrate a System Dynamics (SD) Simulation model. Results provide validation of the Cyclical SRL Model, confirming the interplay of grit, emotion, and performance in the ITS. The Simulation Model enables mathematical simulations depicting a variety of student background types and intervention styles and supporting deeper future explorations of dimensions of student learning.
- 5 February 2021
- Published by Springer Nature in Metacognition and Learning
- Vol. 16 (2) , 367-405
Simulating the dynamics of self-regulation, emotion, grit, and student performance in cyber-learning environments
This research presents the results of development and validation of the Cyclical Self-Regulated Learning (SRL) Simulation Model, a model of student cognitive and metacognitive experiences learning mathematics within an intelligent tutoring system (ITS). Patterned after Zimmerman and Moylan’s (2009) Cyclical SRL Model, the Simulation Model depicts a feedback cycle connecting forethought, performance and self-reflection, with emotion hypothesized as a key determinant of student learning. A mathematical model was developed in steps, using data collected from students during their sessions within the ITS, developing solutions using structural equation modeling, and using these coefficients to calibrate a System Dynamics (SD) Simulation model. Results provide validation of the Cyclical SRL Model, confirming the interplay of grit, emotion, and performance in the ITS. The Simulation Model enables mathematical simulations depicting a variety of student background types and intervention styles and supporting deeper future explorations of dimensions of student learning.
- 1 May 2020
- Published by American Psychological Association (APA) in School Psychology
- Vol. 35 (3) , 179-192
Initial validation of the Classroom Management Observation Tool (CMOT).
Effective classroom management is critical for student and teacher success. Because teachers receive limited preservice preparation and in-service support in classroom management, educational leaders (e.g., school psychologists, behavior coaches, mentor teachers, and administrators) need efficient and effective tools to identify teachers' strengths and needs and to guide professional development. Current approaches to assess teachers' classroom management are either (a) simple and efficient, but have unknown psychometric properties, or (b) psychometrically sound, but resource intensive. Thus, a Classroom Management Observation Tool (CMOT) that is simple, efficient, and has promising psychometric properties would fill a critical need in the field. This article describes the initial development and validation of the CMOT-a four-item rating of teachers' active supervision, opportunities to respond, specific praise, and positive to corrective ratio-and presents promising evidence of content validity, factor structure, interrater reliability, construct validity, and generalizability. Further research is needed to develop this tool for screening, progress monitoring, and other assessment purposes. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
- 1 May 2020
- Published by American Psychological Association (APA) in School Psychology
- Vol. 35 (3) , 179-192
Initial validation of the Classroom Management Observation Tool (CMOT).
Effective classroom management is critical for student and teacher success. Because teachers receive limited preservice preparation and in-service support in classroom management, educational leaders (e.g., school psychologists, behavior coaches, mentor teachers, and administrators) need efficient and effective tools to identify teachers' strengths and needs and to guide professional development. Current approaches to assess teachers' classroom management are either (a) simple and efficient, but have unknown psychometric properties, or (b) psychometrically sound, but resource intensive. Thus, a Classroom Management Observation Tool (CMOT) that is simple, efficient, and has promising psychometric properties would fill a critical need in the field. This article describes the initial development and validation of the CMOT-a four-item rating of teachers' active supervision, opportunities to respond, specific praise, and positive to corrective ratio-and presents promising evidence of content validity, factor structure, interrater reliability, construct validity, and generalizability. Further research is needed to develop this tool for screening, progress monitoring, and other assessment purposes. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
- 22 May 2018
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 43 (5) , 594-627
Does the Package Matter? A Comparison of Five Common Multilevel Modeling Software Packages
This study compared five common multilevel software packages via Monte Carlo simulation: HLM 7, M plus 7.4, R (lme4 V1.1-12), Stata 14.1, and SAS 9.4 to determine how the programs differ in estimation accuracy and speed, as well as convergence, when modeling multiple randomly varying slopes of different magnitudes. Simulated data included population variance estimates, which were zero or near zero for two of the five random slopes. Generally, when yielding admissible solutions, all five software packages produced comparable and reasonably unbiased parameter estimates. However, noticeable differences among the five packages arose in terms of speed, convergence rates, and the production of standard errors for random effects, especially when the variances of these effects were zero in the population. The results of this study suggest that applied researchers should carefully consider which random effects they wish to include in their models. In addition, nonconvergence rates vary across packages, and models that fail to converge in one package may converge in another.
- 22 May 2018
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 43 (5) , 594-627
Does the Package Matter? A Comparison of Five Common Multilevel Modeling Software Packages
This study compared five common multilevel software packages via Monte Carlo simulation: HLM 7, M plus 7.4, R (lme4 V1.1-12), Stata 14.1, and SAS 9.4 to determine how the programs differ in estimation accuracy and speed, as well as convergence, when modeling multiple randomly varying slopes of different magnitudes. Simulated data included population variance estimates, which were zero or near zero for two of the five random slopes. Generally, when yielding admissible solutions, all five software packages produced comparable and reasonably unbiased parameter estimates. However, noticeable differences among the five packages arose in terms of speed, convergence rates, and the production of standard errors for random effects, especially when the variances of these effects were zero in the population. The results of this study suggest that applied researchers should carefully consider which random effects they wish to include in their models. In addition, nonconvergence rates vary across packages, and models that fail to converge in one package may converge in another.
- 24 January 2018
- Published by Taylor & Francis in The Journal of Experimental Education
- Vol. 87 (2) , 214-237
The Impact and Interpretation of Modeling Residual Noninvariance in Growth Mixture Models
Current practices for growth mixture modeling emphasize the importance of the proper parameterization and number of classes, but the impact of these decisions on latent class composition and the substantive implications has not been thoroughly addressed. Using measures of behavior from 575 middle school students, we compared the results of several multilevel growth mixture models. Results indicated a dramatic shift in class assignment as the models allowed class-varying parameters, with different substantive interpretations and resulting typologies. This research suggests that using variability as a criterion for class differences in a behavior typology can dramatically impact latent class membership. This study describes decisions and results from testing for noninvariance, with particular emphasis on how decisions about the nature of within-person variance can affect resulting subgroups and model parameters.
- 24 January 2018
- Published by Taylor & Francis in The Journal of Experimental Education
- Vol. 87 (2) , 214-237
The Impact and Interpretation of Modeling Residual Noninvariance in Growth Mixture Models
Current practices for growth mixture modeling emphasize the importance of the proper parameterization and number of classes, but the impact of these decisions on latent class composition and the substantive implications has not been thoroughly addressed. Using measures of behavior from 575 middle school students, we compared the results of several multilevel growth mixture models. Results indicated a dramatic shift in class assignment as the models allowed class-varying parameters, with different substantive interpretations and resulting typologies. This research suggests that using variability as a criterion for class differences in a behavior typology can dramatically impact latent class membership. This study describes decisions and results from testing for noninvariance, with particular emphasis on how decisions about the nature of within-person variance can affect resulting subgroups and model parameters.
- Open Access
- 1 January 2017
- Published by American Psychological Association (APA) in Psychological Assessment
- Vol. 29 (1) , 98-109
Test order in teacher-rated behavior assessments: Is counterbalancing necessary?
Counterbalancing treatment order in experimental research design is well established as an option to reduce threats to internal validity, but in educational and psychological research, the effect of varying the order of multiple tests to a single rater has not been examined and is rarely adhered to in practice. The current study examines the effect of test order on measures of student behavior by teachers as raters utilizing data from a behavior measure validation study. Using multilevel modeling to control for students nested within teachers, the effect of rating an earlier measure on the intercept or slope of a later behavior assessment was statistically significant in 22% of predictor main effects for the spring test period. Test order effects had potential for high stakes consequences with differences large enough to change risk classification. Results suggest that researchers and practitioners in classroom settings using multiple measures evaluate the potential impact of test order. Where possible, they should counterbalance when the risk of an order effect exists and report justification for the decision to not counterbalance. (PsycINFO Database Record
- 1 January 2017
- Published by American Psychological Association (APA) in Psychological Assessment
- Vol. 29 (1) , 98-109
Open AccessTest order in teacher-rated behavior assessments: Is counterbalancing necessary?
Counterbalancing treatment order in experimental research design is well established as an option to reduce threats to internal validity, but in educational and psychological research, the effect of varying the order of multiple tests to a single rater has not been examined and is rarely adhered to in practice. The current study examines the effect of test order on measures of student behavior by teachers as raters utilizing data from a behavior measure validation study. Using multilevel modeling to control for students nested within teachers, the effect of rating an earlier measure on the intercept or slope of a later behavior assessment was statistically significant in 22% of predictor main effects for the spring test period. Test order effects had potential for high stakes consequences with differences large enough to change risk classification. Results suggest that researchers and practitioners in classroom settings using multiple measures evaluate the potential impact of test order. Where possible, they should counterbalance when the risk of an order effect exists and report justification for the decision to not counterbalance. (PsycINFO Database Record
- 26 September 2016
- Published by Taylor & Francis in Journal of Research in Childhood Education
- Vol. 30 (4) , 456-473
The Kindergarten Transition: Behavioral Trajectories in the First Formal Year of School
During the first year of school, student success hinges on learning not only new academic skills, but also behavioral expectations and developing self-regulation skills in the classroom. The purpose of this study was to investigate development in behavioral regulation during the kindergarten year. The authors used multilevel models to explore the association between sex and risk status on academic engagement and disruptive behavior trajectories based on daily teacher-generated behavioral ratings obtained for 22 full-day kindergarten students (six at risk, 12 male) across 80 school days. Results indicated that, in general, behavior improved over time; academic engagement increased whereas disruptive behavior decreased. However, behavioral trajectories varied as a function of sex and risk status. Implications for practice and directions for future research are discussed.
- 26 September 2016
- Published by Taylor & Francis in Journal of Research in Childhood Education
- Vol. 30 (4) , 456-473
The Kindergarten Transition: Behavioral Trajectories in the First Formal Year of School
During the first year of school, student success hinges on learning not only new academic skills, but also behavioral expectations and developing self-regulation skills in the classroom. The purpose of this study was to investigate development in behavioral regulation during the kindergarten year. The authors used multilevel models to explore the association between sex and risk status on academic engagement and disruptive behavior trajectories based on daily teacher-generated behavioral ratings obtained for 22 full-day kindergarten students (six at risk, 12 male) across 80 school days. Results indicated that, in general, behavior improved over time; academic engagement increased whereas disruptive behavior decreased. However, behavioral trajectories varied as a function of sex and risk status. Implications for practice and directions for future research are discussed.
- 1 July 2016
- Published by Taylor & Francis in Measurement and Evaluation in Counseling and Development
- Vol. 49 (3) , 217-242
Development and Validation of the Mathematical Resilience Scale
The Mathematical Resilience Scale measures students’ attitudes toward studying mathematics, using three correlated factors: Value, Struggle, and Growth. The Mathematical Resilience Scale was developed and validated using exploratory and confirmatory factor analyses across three samples. Results provide a new approach to gauge the likelihood of student participation and persistence in mathematics.
- 1 July 2016
- Published by Taylor & Francis in Measurement and Evaluation in Counseling and Development
- Vol. 49 (3) , 217-242
Development and Validation of the Mathematical Resilience Scale
The Mathematical Resilience Scale measures students’ attitudes toward studying mathematics, using three correlated factors: Value, Struggle, and Growth. The Mathematical Resilience Scale was developed and validated using exploratory and confirmatory factor analyses across three samples. Results provide a new approach to gauge the likelihood of student participation and persistence in mathematics.