RBRebecca Berenbon

Rebecca Berenbon

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Rebecca Berenbon has a total of 14 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • The Modifying Effects of Response Style on the Criterion-Related Validity of a Curriculum-Based Measure

    by Rebecca F. Berenbon, Jerome V. D’aGostino, Emily M. Rodgers

    Curriculum-based measures (CBMs) such as Word Identification Fluency promote student achievement, but because they are timed and administered frequently, they are prone to variation in student response styles. To study the impact of WIF response styles, we created and examined the validity of a novel response style measure and examined the degree to which it moderated the validity of WIF growth slopes as a predictor of student outcomes. Students who moved quickly through the WIF (speeders) exhibited greater growth compared to non-speeders with similar WIF slopes on a criterion measure, and WIF growth explained the most variance in growth on the criterion measure among speeders. Response style was rather consistent within students and across students within teachers, suggesting that teachers’ instructions and testing practices may influence how students approach the tests. Implications of the findings for effective CBM testing are discussed.

  • Open Access

    Bias in job analysis survey ratings attributed to order effects

    by Rebecca Berenbon, Bridget McHugh, Philomina Abena Anyidoho

    When respondents complete long surveys, evidence suggests that they may change their response behavior as they become fatigued. The present study examines question order effects in a block‐randomized job analysis survey that collected task ratings (importance, frequency, and needed at certification) for a certification program. Analyses showed that average task ratings were lower for tasks presented later in the survey for both complete and partial responses, though the effect of question ordering was stronger for non‐completers in two rating categories (importance and needed at certification). Additionally, rater variance was lower for questions that appeared later in the survey. The results highlight the value of using randomization to mitigate order effects on survey response quality.


  • Open Access

    Examining the influence of item exposure and retrieval practice effects on test performance in a large‐scale workforce development training programme

    by Philomina Abena Anyidoho, Rebecca Berenbon, Bridget McHugh

    Many workforce development training programmes use learning gains as a measure of programme effectiveness. However, research on K‐12 education suggests that posttest scores may be influenced by pretesting effects. Pretesting may improve posttest performance by giving learners preknowledge of posttest content. Alternatively, pretesting may enhance learning via the retrieval practice effect. Cross‐classified analysis was used to detect pretesting effects in archival data from a large‐scale agriculture workforce development programme. Data included scores from 14,302 learners, 352 trainers and 261 training centres. Results indicated that pretesting led to higher scores on posttests. Follow‐up logistic regression analyses found no effect for time lag between pretest and posttest. In addition, pretested learners did not perform better on items that were included on both forms, suggesting that score differences were due to retrieval practice effects rather than preknowledge of posttest content. These results provide evidence that pretesting may enhance learning in large‐scale workforce development training courses.


  • Open Access

    Do Subject Matter Experts’ Judgments of Multiple‐Choice Format Suitability Predict Item Quality?

    by Rebecca F. Berenbon, Bridget C. McHugh

    To assemble a high‐quality test, psychometricians rely on subject matter experts (SMEs) to write high‐quality items. However, SMEs are not typically given the opportunity to provide input on which content standards are most suitable for multiple‐choice questions (MCQs). In the present study, we explored the relationship between perceived MCQ suitability for a given content standard and the associated item characteristics. Prior to item writing, we surveyed SMEs on MCQ suitability for each content standard. Following field testing, we then used SMEs’ average ratings for each content standard to predict item characteristics for the tests. We analyzed multilevel models predicting item difficulty (p value), discrimination, and nonfunctioning distractor presence. Items were nested within courses and content standards. There was a curvilinear relationship between SMEs’ ratings and item difficulty such that very low MCQ suitability ratings were predictive of easier items. After controlling for item difficulty, items with higher MCQ suitability ratings had higher discrimination and were less likely to have one or more nonfunctioning distractors. This research has practical implications for optimizing test blueprints. Additionally, psychometricians may use these ratings to better prepare for coaching SMEs during item writing.


  • An In-Depth Analysis of the Perceived Stress Scale Among College Freshmen and Transfer Students

    by Meng-Ting Lo, Andrew H. Perry, Rebecca Berenbon

    The PSS10 has been used widely and is helpful to identify at-risk individuals for clinical mental illness such that timely early intervention can be provided. Directions for applying PSS10 with college freshmen and transfer students are suggested noting several non-negligible psychometric concerns including gender bias and violation of ordinality assumption.


  • Teachers’ Beliefs and Their Students’ Progress in Professional Development

    by Emily Rodgers, Jerome D’aGostino, Rebecca Berenbon, Clara Mikita, Christa Winkler, Mollie E. Wright

    We respond to calls for more research to address whether and how successful professional development (PD) experiences (defined here in terms of student progress) are related to changes in teacher beliefs, specifically about effective literacy instruction for young struggling readers. We developed a measure, a Teacher Belief Score, to identify teacher beliefs present in interview data and we used student achievement data to create two contrasting groups of teachers, those whose students had lower progress and those who had higher. While initially in the fall, lower progress and higher progress teachers differed little in their alignment of beliefs with program features; over time, higher progress teachers trended toward beliefs that were aligned with program features, whereas lower progress teachers trended away. Findings suggest the need for an additional component to Guskey’s model of teacher change: attributing student progress to the new instructional practices learned in PD.


  • Validation of a survey for measuring scientists' attitudes toward data reuse

    by Christa E. Winkler, Rebecca Fay Berenbon

    This study investigated the validity of a survey measuring scientists' attitudes toward data reuse. Rasch analysis was used to examine the psychometric properties of the survey. Structural equation modeling was subsequently used to examine the validity of hypothesized relationships among the constructs measured by the survey. Overall, findings supported validity of the existing measure for use among researchers across academic disciplines. Recommendations for further refinement of the survey include the addition of new items to improve reliability of measurement. Additionally, implications for organizational practice are discussed, including the importance of fostering individual researchers' perceived usefulness of secondary data, as well as providing access to data repositories and organizational resources for data reuse.


  • Targeting Prompts When Scaffolding Word Solving During Guided Reading

    by Clara Mikita, Emily Rodgers, Rebecca Berenbon, Christa Winkler

    Recent research on scaffolding has examined both the sources of information used and neglected during students' word‐solving attempts and the amount of information provided in teachers' word‐solving prompts. In this teaching tip, the authors expand the application of such research from one‐to‐one student–teacher interactions to a guided reading setting. The authors provide examples to illustrate how teachers can critically evaluate students' word‐solving attempts and consequently respond to the readers' needs within the guided reading context. The dual focus that the authors suggest, making decisions about both the type and amount of information, provides a framework through which teachers can implement scaffolding during their guided reading lessons.


  • Using Rasch analysis to investigate the validity of the Everyday Discrimination Scale in a national sample

    by Rebecca F Berenbon

    The Everyday Discrimination Scale (EDS) is a widely used measure of discrimination. Rasch analysis was used to examine the psychometric properties of the EDS based on a national sample (N = 2666). Items largely fit the Rasch model and yielded excellent separation and item reliability. However, severe floor effects were observed. Implications are discussed for use of the scale in populations that experience low levels of discrimination. An ordinal-to-interval conversion table for the EDS is also provided.