Katharine Reid
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Katharine Reid has a total of 65 co-authors. Here are the top co-authors by number of shared publications:
- Agnes E. Dodds
University of Melbourne, Australia
7 shared publications - Geoff McColl
University of Melbourne, Melbourne, VIC
5 shared publications - Neville Chiavaroli
Australian Council for Educational Research
5 shared publications Agnes Dodds
4 shared publications- Jacob Pearce
Specialist & Professional Education & Assessment Research, Australian Council for Educational Research
3 shared publications David Smallwood
Royal Melbourne Clinical School, Melbourne Medical School, The University of Melbourne, Melbourne, VIC, Australia
2 shared publications
Latest Publications
- 21 April 2025
- Published by Wiley in Medical Education
- Vol. 59 (9) , 908-909
When I say … assessment burden
High‐quality assessment might elicit feelings of burden, but has significant utility in guiding learning and maintaining professional standards.
- 21 April 2025
- Published by Wiley in Medical Education
- Vol. 59 (9) , 908-909
When I say … assessment burden
High‐quality assessment might elicit feelings of burden, but has significant utility in guiding learning and maintaining professional standards.
- Open Access
- 22 May 2024
- Published by Springer Nature in BMC Nursing
- Vol. 23 (1) , 1-11
Preparedness for a first clinical placement in nursing: a descriptive qualitative study
Background: A first clinical placement for nursing students is a challenging period involving translation of theoretical knowledge and development of an identity within the healthcare setting; it is often a time of emotional vulnerability. It can be a pivotal moment for ambivalent nursing students to decide whether to continue their professional training. To date, student expectations prior to their first clinical placement have been explored in advance of the experience or gathered following the placement experience. However, there is a significant gap in understanding how nursing students’ perspectives about their first clinical placement might change or remain consistent following their placement experiences. Thus, the study aimed to explore first-year nursing students’ emotional responses towards and perceptions of their preparedness for their first clinical placement and to examine whether initial perceptions remain consistent or change during the placement experience. Methods: The research utilised a pre-post qualitative descriptive design. Six focus groups were undertaken before the first clinical placement (with up to four participants in each group) and follow-up individual interviews (n = 10) were undertaken towards the end of the first clinical placement with first-year entry-to-practice postgraduate nursing students. Data were analysed thematically. Results: Three main themes emerged: (1) adjusting and managing a raft of feelings, encapsulating participants’ feelings about learning in a new environment and progressing from academia to clinical practice; (2) sinking or swimming, comprising students’ expectations before their first clinical placement and how these perceptions are altered through their clinical placement experience; and (3) navigating placement, describing relationships between healthcare staff, patients, and peers. Conclusions: This unique study of first-year postgraduate entry-to-practice nursing students’ perspectives of their first clinical placement adds to the extant knowledge. By examining student experience prior to and during their first clinical placement experience, it is possible to explore the consistency and change in students’ narratives over the course of an impactful experience. Researching the narratives of nursing students embarking on their first clinical placement provides tertiary education institutions with insights into preparing students for this critical experience.
- 22 May 2024
- Published by Springer Nature in BMC Nursing
- Vol. 23 (1) , 1-11
Open AccessPreparedness for a first clinical placement in nursing: a descriptive qualitative study
Background: A first clinical placement for nursing students is a challenging period involving translation of theoretical knowledge and development of an identity within the healthcare setting; it is often a time of emotional vulnerability. It can be a pivotal moment for ambivalent nursing students to decide whether to continue their professional training. To date, student expectations prior to their first clinical placement have been explored in advance of the experience or gathered following the placement experience. However, there is a significant gap in understanding how nursing students’ perspectives about their first clinical placement might change or remain consistent following their placement experiences. Thus, the study aimed to explore first-year nursing students’ emotional responses towards and perceptions of their preparedness for their first clinical placement and to examine whether initial perceptions remain consistent or change during the placement experience. Methods: The research utilised a pre-post qualitative descriptive design. Six focus groups were undertaken before the first clinical placement (with up to four participants in each group) and follow-up individual interviews (n = 10) were undertaken towards the end of the first clinical placement with first-year entry-to-practice postgraduate nursing students. Data were analysed thematically. Results: Three main themes emerged: (1) adjusting and managing a raft of feelings, encapsulating participants’ feelings about learning in a new environment and progressing from academia to clinical practice; (2) sinking or swimming, comprising students’ expectations before their first clinical placement and how these perceptions are altered through their clinical placement experience; and (3) navigating placement, describing relationships between healthcare staff, patients, and peers. Conclusions: This unique study of first-year postgraduate entry-to-practice nursing students’ perspectives of their first clinical placement adds to the extant knowledge. By examining student experience prior to and during their first clinical placement experience, it is possible to explore the consistency and change in students’ narratives over the course of an impactful experience. Researching the narratives of nursing students embarking on their first clinical placement provides tertiary education institutions with insights into preparing students for this critical experience.
- 5 March 2024
- Published by University of Toronto Press Inc. (UTPress) in Journal of Veterinary Medical Education
- Vol. 51 (1) , 3-13
Accreditation Approaches for Professional Education Programs: Toward Best Practice
Accreditation has a central role in the quality assurance of professional education programs, but research on the effectiveness of different models of accreditation is limited. The purpose of this study was to rapidly appraise the evidence for the effectiveness, impact, and feasibility of different accreditation approaches, in order to inform best practices for the accreditation of professional education programs. The study focused on accreditation for programs that produce practice-ready graduates, including for veterinary programs. The authors searched several databases for articles published from 2000 to 2020, using search terms identified during a scoping phase, and applied a “rapid review” methodology in line with contextual, time, and resource requirements. Relevant articles that were classed as empirical or conceptual were included in the study, while papers appraised as solely commentaries or descriptive were excluded from the evidence base. The full-text review included 32 articles. We identified a clear transition in the literature from input- and process-based models (pre- and early 2000s) to outcomes-based models (in the 2000s and early 2010s). Continuous quality improvement and targeted models (including risk-based and thematic) represent more recent approaches in accreditation practice. However, as noted by other scholars, we identified limited empirical evidence for the relative effectiveness of different accreditation approaches in professional education, although evidence for the more recent accreditation approaches is emerging. In terms of best practice in view of the current lack of definitive evidence for the adoption of any specific model of accreditation, we argue that accrediting authorities adopt a contextual approach to accreditation that includes clearly articulating the purpose and focus of their regulatory activities, and selecting and implementing accreditation methods that are consistent with their underlying principles.
- 5 March 2024
- Published by University of Toronto Press Inc. (UTPress) in Journal of Veterinary Medical Education
- Vol. 51 (1) , 3-13
Accreditation Approaches for Professional Education Programs: Toward Best Practice
Accreditation has a central role in the quality assurance of professional education programs, but research on the effectiveness of different models of accreditation is limited. The purpose of this study was to rapidly appraise the evidence for the effectiveness, impact, and feasibility of different accreditation approaches, in order to inform best practices for the accreditation of professional education programs. The study focused on accreditation for programs that produce practice-ready graduates, including for veterinary programs. The authors searched several databases for articles published from 2000 to 2020, using search terms identified during a scoping phase, and applied a “rapid review” methodology in line with contextual, time, and resource requirements. Relevant articles that were classed as empirical or conceptual were included in the study, while papers appraised as solely commentaries or descriptive were excluded from the evidence base. The full-text review included 32 articles. We identified a clear transition in the literature from input- and process-based models (pre- and early 2000s) to outcomes-based models (in the 2000s and early 2010s). Continuous quality improvement and targeted models (including risk-based and thematic) represent more recent approaches in accreditation practice. However, as noted by other scholars, we identified limited empirical evidence for the relative effectiveness of different accreditation approaches in professional education, although evidence for the more recent accreditation approaches is emerging. In terms of best practice in view of the current lack of definitive evidence for the adoption of any specific model of accreditation, we argue that accrediting authorities adopt a contextual approach to accreditation that includes clearly articulating the purpose and focus of their regulatory activities, and selecting and implementing accreditation methods that are consistent with their underlying principles.
- Open Access
- 1 March 2024
- Published by Australian Council for Educational Research
ACER’s Mathematics Anxiety and Engagement Strategy (MAES): A framework
The Mathematics Anxiety and Engagement Strategy (MAES) was established by the Australian Council for Educational Research (ACER) in 2018 in response to declining mathematics achievement and participation among Australian students. Findings from the 2022 cycle of the Programme for International Student Assessment (PISA) show that 15-year-old students in Australia had significantly lower levels of mathematical literacy than students in 2003 (De Bortoli et al, 2023). The 2022 results also showed that male students outperformed female students and only 30 percent of students from more disadvantaged backgrounds achieved the National Proficient Standard in mathematics compared to 72 percent of students from more advantaged backgrounds. In 2022, the Australian Mathematical Sciences Institute (AMSI) reported that the number of Australian students enrolling in one or more mathematics subjects in Year 12 was continuing to decline (Wienk, 2022). There was also an increasing gender gap, with AMSI noting that only 38 percent of students enrolled in more-advanced mathematics subjects were female. Other research suggests that belief in mathematical ability may be a key factor influencing female students’ decision to enrol in upper secondary STEM subjects (Watt et al, 2017). These findings highlight that improving mathematics engagement could be a key lever to addressing gender equity in STEM and to addressing socioeconomic disadvantage. The aim in developing MAES was to help counter declining mathematics achievement and participation by identifying and removing significant barriers to students’ positive engagement with mathematics. MAES uses an innovative, multidisciplinary approach that is informed by research in education, psychology, and neuroscience. Namely, MAES offers key research findings in a format that is useable for educators and policymakers. To guide the direction of MAES, an Advisory Board was established that includes academics and education stakeholders from around Australia.
- 1 March 2024
- Published by Australian Council for Educational Research
Open AccessACER’s Mathematics Anxiety and Engagement Strategy (MAES): A framework
The Mathematics Anxiety and Engagement Strategy (MAES) was established by the Australian Council for Educational Research (ACER) in 2018 in response to declining mathematics achievement and participation among Australian students. Findings from the 2022 cycle of the Programme for International Student Assessment (PISA) show that 15-year-old students in Australia had significantly lower levels of mathematical literacy than students in 2003 (De Bortoli et al, 2023). The 2022 results also showed that male students outperformed female students and only 30 percent of students from more disadvantaged backgrounds achieved the National Proficient Standard in mathematics compared to 72 percent of students from more advantaged backgrounds. In 2022, the Australian Mathematical Sciences Institute (AMSI) reported that the number of Australian students enrolling in one or more mathematics subjects in Year 12 was continuing to decline (Wienk, 2022). There was also an increasing gender gap, with AMSI noting that only 38 percent of students enrolled in more-advanced mathematics subjects were female. Other research suggests that belief in mathematical ability may be a key factor influencing female students’ decision to enrol in upper secondary STEM subjects (Watt et al, 2017). These findings highlight that improving mathematics engagement could be a key lever to addressing gender equity in STEM and to addressing socioeconomic disadvantage. The aim in developing MAES was to help counter declining mathematics achievement and participation by identifying and removing significant barriers to students’ positive engagement with mathematics. MAES uses an innovative, multidisciplinary approach that is informed by research in education, psychology, and neuroscience. Namely, MAES offers key research findings in a format that is useable for educators and policymakers. To guide the direction of MAES, an Advisory Board was established that includes academics and education stakeholders from around Australia.
- Open Access
- 18 August 2022
- Published by Springer Nature in BMC Medical Education
- Vol. 22 (1) , 1-12
Preparedness for practice of newly qualified dental practitioners in the Australian context: an exploratory study
Background: The current study explored the perspectives of preparedness for dental practice from a range of relevant stakeholders (i.e., educators, employers, final-year students, graduates, practitioners, and professional associations) using an anonymous online survey in which participants described either their preparedness for practice, or the preparedness of graduates they have encountered, across six domains. Results: A total of 120 participants completed the survey. Participants were from several Australian states and territories; regional, rural, and urban locations; and working in the public and private sector. Students and new graduates generally felt prepared for activities in all the identified domains. Stakeholders reported consistently that the knowledge of dental profession graduates was at the required level to enter practice in Australia in a safe way. Activities involving the knowledge of clinical entrepreneurship and financial solvency were the dimensions where students and graduates felt least prepared (e.g., explaining fees, negotiating finances). In the domains involving clinical and technical competencies, students and new graduates self-assessed as less prepared around managing dental trauma and medical emergencies. On the other hand, activities around social and community orientation, and to a lesser extent professional attitudes and ethical judgements, were the dimensions where students and graduates felt the most prepared. Conclusions: Present findings indicate that there appear to be good standards of preparedness for practice for graduate dental professionals. This exploratory study provides insights into the nature of preparedness for Australian dental professionals and provides a basis for targeting education and professional development to address areas of need.
- 18 August 2022
- Published by Springer Nature in BMC Medical Education
- Vol. 22 (1) , 1-12
Open AccessPreparedness for practice of newly qualified dental practitioners in the Australian context: an exploratory study
Background: The current study explored the perspectives of preparedness for dental practice from a range of relevant stakeholders (i.e., educators, employers, final-year students, graduates, practitioners, and professional associations) using an anonymous online survey in which participants described either their preparedness for practice, or the preparedness of graduates they have encountered, across six domains. Results: A total of 120 participants completed the survey. Participants were from several Australian states and territories; regional, rural, and urban locations; and working in the public and private sector. Students and new graduates generally felt prepared for activities in all the identified domains. Stakeholders reported consistently that the knowledge of dental profession graduates was at the required level to enter practice in Australia in a safe way. Activities involving the knowledge of clinical entrepreneurship and financial solvency were the dimensions where students and graduates felt least prepared (e.g., explaining fees, negotiating finances). In the domains involving clinical and technical competencies, students and new graduates self-assessed as less prepared around managing dental trauma and medical emergencies. On the other hand, activities around social and community orientation, and to a lesser extent professional attitudes and ethical judgements, were the dimensions where students and graduates felt the most prepared. Conclusions: Present findings indicate that there appear to be good standards of preparedness for practice for graduate dental professionals. This exploratory study provides insights into the nature of preparedness for Australian dental professionals and provides a basis for targeting education and professional development to address areas of need.
- Open Access
- 1 January 2022
- Published by SAGE Publications in Journal of Medical Education and Curricular Development
- Vol. 9
Assessing a Capstone Research Project in Medical Training: Examiner Consistency Using Generic Versus Domain-Specific Rubrics
Rubrics are utilized extensively in tertiary contexts to assess student performance on written tasks; however, their use for assessment of research projects has received little attention. In particular, there is little evidence on the reliability of examiner judgements according to rubric type (general or specific) in a research context. This research examines the concordance between pairs of examiners assessing a medical student research project during a two-year period employing a generic rubric followed by a subsequent two-year implementation of task-specific rubrics. Following examiner feedback, and with consideration to the available literature, we expected the task-specific rubrics would increase the consistency of examiner judgements and reduce the need for arbitration due to discrepant marks. However, in contrast, results showed that generic rubrics provided greater consistency of examiner judgements and fewer arbitrations compared with the task-specific rubrics. These findings have practical implications for educational practise in the assessment of research projects and contribute valuable empirical evidence to inform the development and use of rubrics in medical education.
- 1 January 2022
- Published by SAGE Publications in Journal of Medical Education and Curricular Development
- Vol. 9
Open AccessAssessing a Capstone Research Project in Medical Training: Examiner Consistency Using Generic Versus Domain-Specific Rubrics
Rubrics are utilized extensively in tertiary contexts to assess student performance on written tasks; however, their use for assessment of research projects has received little attention. In particular, there is little evidence on the reliability of examiner judgements according to rubric type (general or specific) in a research context. This research examines the concordance between pairs of examiners assessing a medical student research project during a two-year period employing a generic rubric followed by a subsequent two-year implementation of task-specific rubrics. Following examiner feedback, and with consideration to the available literature, we expected the task-specific rubrics would increase the consistency of examiner judgements and reduce the need for arbitration due to discrepant marks. However, in contrast, results showed that generic rubrics provided greater consistency of examiner judgements and fewer arbitrations compared with the task-specific rubrics. These findings have practical implications for educational practise in the assessment of research projects and contribute valuable empirical evidence to inform the development and use of rubrics in medical education.
- 8 March 2021
- Published by Wiley in Medical Education
- Vol. 55 (5) , 639
Standard setting using programmatic thinking for small cohort performance‐based exams
- 8 March 2021
- Published by Wiley in Medical Education
- Vol. 55 (5) , 639
Standard setting using programmatic thinking for small cohort performance‐based exams
- 8 February 2021
- Published by Taylor & Francis in Medical Teacher
- Vol. 43 (5) , 567-574
Incorporating aspects of programmatic assessment into examinations: Aggregating rich information to inform decision-making
A programmatic approach to assessment entails gathering and aggregating ‘rich information’ on candidates to inform progress decisions. However, there is little guidance on how such an approach might be implemented in practice. We describe an approach to aggregating rich information across assessment formats to inform committee decision-making in a specialist medical college. Each item (n = 272) for every examination was blueprinted to 15 curriculum modules and 7 proficiencies. We developed a six-point holistic rating scale with detailed rubrics outlining expected performance standards for every item. Examiners used this rating scale in making judgements for each item, generating rich performance data for each candidate. A colour-coded ‘mosaic’ of patterns of performance across modules and proficiencies was generated along with frequency distributions of ratings. These data allowed examiners to easily visualise candidate performance and to use these data to inform deliberations on borderline candidates. Committee decision-making was facilitated by maintaining the richness of assessment information throughout the process. Moreover, the data facilitated detailed and useful feedback to candidates. Our study demonstrates that incorporating aspects of programmatic thinking into high-stakes examinations by using a novel approach to aggregating information is a useful first step in reforming an assessment program.
- 8 February 2021
- Published by Taylor & Francis in Medical Teacher
- Vol. 43 (5) , 567-574
Incorporating aspects of programmatic assessment into examinations: Aggregating rich information to inform decision-making
A programmatic approach to assessment entails gathering and aggregating ‘rich information’ on candidates to inform progress decisions. However, there is little guidance on how such an approach might be implemented in practice. We describe an approach to aggregating rich information across assessment formats to inform committee decision-making in a specialist medical college. Each item (n = 272) for every examination was blueprinted to 15 curriculum modules and 7 proficiencies. We developed a six-point holistic rating scale with detailed rubrics outlining expected performance standards for every item. Examiners used this rating scale in making judgements for each item, generating rich performance data for each candidate. A colour-coded ‘mosaic’ of patterns of performance across modules and proficiencies was generated along with frequency distributions of ratings. These data allowed examiners to easily visualise candidate performance and to use these data to inform deliberations on borderline candidates. Committee decision-making was facilitated by maintaining the richness of assessment information throughout the process. Moreover, the data facilitated detailed and useful feedback to candidates. Our study demonstrates that incorporating aspects of programmatic thinking into high-stakes examinations by using a novel approach to aggregating information is a useful first step in reforming an assessment program.
- Open Access
- 1 January 2020
- Published by Australian Council for Educational Research
Systematic review of the literature on professional education accreditation
This report is a critical and systematic review of the literature on professional education accreditation models, associated methods, and the effectiveness and impact of each model. The review was conducted to inform a review and update of the Royal College of Veterinary Surgeons (RCVS) standards of accreditation for veterinary degrees. The purpose of the study was to rapidly appraise the evidence for the effectiveness, impact, and feasibility of different accreditation approaches, in order to inform best practices for the accreditation of professional education programs. The study focused on accreditation for programs which produce practice-ready graduates, including for veterinary programs. The authors searched several databases for articles published from 2000 to 2020, using search terms identified during a scoping phase, and applied a rapid review methodology in line with contextual, time, and resource requirements. The full-text review included 32 articles, from which a clear transition in the literature was seen from input- and process-based models (pre- and early 2000s) to outcomes-based models (in the 2000s and early 2010s). Continuous quality improvement and targeted models (including risk-based and thematic) represent more recent approaches in accreditation practice. However the review identified limited empirical evidence for the relative effectiveness of different accreditation approaches in professional education, although evidence for the more recent accreditation approaches is emerging.
- 1 January 2020
- Published by Australian Council for Educational Research
Open AccessSystematic review of the literature on professional education accreditation
This report is a critical and systematic review of the literature on professional education accreditation models, associated methods, and the effectiveness and impact of each model. The review was conducted to inform a review and update of the Royal College of Veterinary Surgeons (RCVS) standards of accreditation for veterinary degrees. The purpose of the study was to rapidly appraise the evidence for the effectiveness, impact, and feasibility of different accreditation approaches, in order to inform best practices for the accreditation of professional education programs. The study focused on accreditation for programs which produce practice-ready graduates, including for veterinary programs. The authors searched several databases for articles published from 2000 to 2020, using search terms identified during a scoping phase, and applied a rapid review methodology in line with contextual, time, and resource requirements. The full-text review included 32 articles, from which a clear transition in the literature was seen from input- and process-based models (pre- and early 2000s) to outcomes-based models (in the 2000s and early 2010s). Continuous quality improvement and targeted models (including risk-based and thematic) represent more recent approaches in accreditation practice. However the review identified limited empirical evidence for the relative effectiveness of different accreditation approaches in professional education, although evidence for the more recent accreditation approaches is emerging.
- Open Access
- 1 January 2019
- Published by SAGE Publications in Journal of Medical Education and Curricular Development
- Vol. 6
Assessing Diagnostic Reasoning Using a Standardized Case-Based Discussion
Background: Development of diagnostic reasoning (DR) is fundamental to medical students’ training, but assessing DR is challenging. Several written assessments focus on DR but lack the ability to dynamically assess DR. Oral assessment formats have strengths but have largely lost favour due to concerns about low reliability and lack of standardization. Medical schools and specialist medical colleges value many forms of oral assessment (eg, long case, Objective Structured Clinical Examination [OSCE], viva voce) but are increasingly searching for ways in which to standardize these formats. We sought to develop and trial a Standardized Case-Based Discussion (SCBD), a highly standardized and interactive oral assessment of DR. Methods: Two initial cohorts of medical students (n = 319 and n = 342) participated in the SCBD as part of their assessments. All students watch a video trigger (based on an authentic clinical case) and discuss their DR with an examiner for 15 minutes. Examiners probe students’ DR and assess how students respond to new standardized clinical information. An online examiner training module clearly articulates expected student performance standards. We used student achievement and student and examiner perceptions to gauge the performance of this new assessment form over 2 implementation years. Results: The SCBD was feasible to implement for a large student cohort and was acceptable to students and examiners. Most students and all examiners agreed that the SCBD discussion provided useful information on students’ DR. The assessment had acceptable internal consistency, and the associations with other assessment formats were small and positive, suggesting that the SCBD measures a related, yet novel construct. Conclusions: Rigorous, standardized oral assessments have a place in a programme of assessment in initial medical training because they provide opportunities to explore DR that are limited in other formats. We plan to incorporate an SCBD into our clinical assessments for the first year of clinical training, where teaching and assessing basic DR is emphasized. We will also explore further examiners’ understanding of and approach to assessing DR.
- 1 January 2019
- Published by SAGE Publications in Journal of Medical Education and Curricular Development
- Vol. 6
Open AccessAssessing Diagnostic Reasoning Using a Standardized Case-Based Discussion
Background: Development of diagnostic reasoning (DR) is fundamental to medical students’ training, but assessing DR is challenging. Several written assessments focus on DR but lack the ability to dynamically assess DR. Oral assessment formats have strengths but have largely lost favour due to concerns about low reliability and lack of standardization. Medical schools and specialist medical colleges value many forms of oral assessment (eg, long case, Objective Structured Clinical Examination [OSCE], viva voce) but are increasingly searching for ways in which to standardize these formats. We sought to develop and trial a Standardized Case-Based Discussion (SCBD), a highly standardized and interactive oral assessment of DR. Methods: Two initial cohorts of medical students (n = 319 and n = 342) participated in the SCBD as part of their assessments. All students watch a video trigger (based on an authentic clinical case) and discuss their DR with an examiner for 15 minutes. Examiners probe students’ DR and assess how students respond to new standardized clinical information. An online examiner training module clearly articulates expected student performance standards. We used student achievement and student and examiner perceptions to gauge the performance of this new assessment form over 2 implementation years. Results: The SCBD was feasible to implement for a large student cohort and was acceptable to students and examiners. Most students and all examiners agreed that the SCBD discussion provided useful information on students’ DR. The assessment had acceptable internal consistency, and the associations with other assessment formats were small and positive, suggesting that the SCBD measures a related, yet novel construct. Conclusions: Rigorous, standardized oral assessments have a place in a programme of assessment in initial medical training because they provide opportunities to explore DR that are limited in other formats. We plan to incorporate an SCBD into our clinical assessments for the first year of clinical training, where teaching and assessing basic DR is emphasized. We will also explore further examiners’ understanding of and approach to assessing DR.