Enhancing Quality of Guidance and Counseling in Vocational Schools: Testing the Effectiveness of Evaluation Instruments Based on the CIPP Model
Open Access
- 26 February 2024
- journal article
- research article
- Published by Universitas Sebelas Maret in PAEDAGOGIA
- Vol. 27 (1) , 73-82
Abstract
This study assesses the CIPP (Context, Input, Process, Product) model's effectiveness in evaluating guidance and counseling programs within the Merdeka curriculum of Vocational High Schools. Collaborating with three experts—guidance and counseling specialists, educational technology experts, and practitioner teachers—the research employs assessment tests and pre-test/post-test questionnaires for 10 Guidance and Counseling Teachers at Vocational High School 3 Banjarmasin. Evaluation results, covering general, specific, and material aspects, show a high level of agreement among the three evaluators. General evaluation exhibits high reliability (ICC = 0.750), and thorough and material evaluations demonstrate high reliability with ICC values of 0.794 each. The trial of 10 Guidance and Counseling Teachers reveals a significant improvement in their evaluation skills after implementing the CIPP model. Average post-test results are notably higher than pre-test, highlighting the positive impact of the CIPP evaluation model on enhancing these skills. The research concludes that the CIPP evaluation model is reliable and consistent in measuring guidance and counseling program effectiveness in the Merdeka curriculum of Vocational High Schools. Empirical and theoretical support establishes a strong foundation for considering future implementation of the CIPP model in educational program evaluations. This model's application is anticipated to elevate the quality and relevance of educational programs, particularly in the context of guidance and counseling in Vocational High Schools, with potential practical and managerial benefits.Keywords
This publication has 15 references indexed in Scilit:
- Student mentoring to enhance graduates’ employability potentialScience & Justice, 2022
- Thematic learning during the pandemic: CIPP evaluation studyCypriot Journal of Educational Sciences, 2021
- A COMPARATIVE ANALYSIS OF THE EFFICACY OF THREE PROGRAM-EVALUATION MODELS –A REVIEW ON THEIR IMPLICATION IN EDUCATIONAL PROGRAMSHumanities & Social Sciences Reviews, 2021
- Evaluation of a Strategic Management Program: Context, Input, Process, Product Model as a Prototype for Business AcademiesTEM Journal, 2021
- Virtual HRD’s Role in Crisis and the Post Covid-19 Professional Lifeworld: Accelerating Skills for Digital TransformationAdvances in Developing Human Resources, 2021
- Evaluation of employees’ vocational training programmes and professional development: A case study in GreeceJournal of Adult and Continuing Education, 2020
- Social Accountability Frameworks and Their Implications for Medical Education and Program Evaluation: A Narrative ReviewAcademic Medicine, 2020
- Online University Teaching During and After the Covid-19 Crisis: Refocusing Teacher Presence and Learning ActivityPostdigital Science and Education, 2020
- Guiding change in higher education: an emergent, iterative application of Kotter’s change modelStudies in Higher Education, 2020
- Barriers and solutions to online learning in medical education – an integrative reviewBMC Medical Education, 2018