Using the internet to improve HRD research
Authors:
- 4 September 2007
- journal article
- Published by Emerald Publishing in Journal of European Industrial Training
- Vol. 31 (7) , 570-587
Abstract
Purpose – The purpose of this article is to highlight the results of the online Delphi research project; in particular the procedures used to establish an online and innovative process of content validation and obtaining “rich” and descriptive information using the internet and current e-learning technologies. The online Delphi was proven to be an excellent tool in establishing content validity for an HRD-related construct, e.g. adult learning principles. A review of related literature revealed no existing research that used a web-based Delphi technique to validate measurements used in training and development (T&D) or HRD. Design/methodology/approach – Research methods included: a thorough review of the literature to construct an item pool of adult learning principles and instructional methods, and a Delphi expert panel consensus. The mean, mode, standard deviation, interquartile range, and skewness of the data were calculated from the voting procedures for determination of consensus. Evidence of reliability was indicated by the interrater reliability coefficient from a field test. In addition, the Gunning FOG Index for readability was calculated to improve the readability of the instrument. Findings – To address the first research question the authors suggest that a valid instrument can be developed by a diverse Delphi expert panel that measures the application of adult learning principles to fully-mediated world wide web-based training. The second research question was answered by illustrating that the internet can assist a group of diverse and geographically dispersed subject-matter experts in establishing a content valid measurement of instructional methods and techniques that demonstrate the application of adult learning principles to fully-mediated web-based training. And, finally, the paper concludes that a Delphi process can be established as a web-based method to validate research measures. Practical implications – This research helps to address the critical issue of how research is used in practice. Reasons why this research lends itself more to practice than other HRD research using more common qualitative or quantitative methods include: it is a relatively simple procedure requiring less than expert-level skills; the Delphi uses expert opinion that is commonly used in training and development practice; and results are easy to interpret and practical. Originality/value – This research is unique in its approach to developing a content valid instrument using state-of-the-art technology coupled with a updated Delphi method. It is valuable to HRD and other professionals and researchers interested in developing valid measures across cultures and where experts are geographically dispersed.Keywords
This publication has 16 references indexed in Scilit:
- The development of the field of HRD: a Delphi studyJournal of European Industrial Training, 2006
- A study to identify the training needs of life insurance sales representatives in Taiwan using the Delphi approachInternational Journal of Training and Development, 2006
- Clinical Experiences For Agricultural Teacher Education Programs In North Carolina, South Carolina, & VirginiaJournal of Agricultural Education, 2003
- Delphi: myths and realityJournal of Health Organization and Management, 2003
- Developing the e‐Delphi system: a web‐based forecasting tool for educational researchBritish Journal of Educational Technology, 2002
- Computer‐mediated communication requirements for group supportJournal of Organizational Computing, 1991
- Conditions of Participation in Rural, Non‐Formal Education Programmes: A Delphi StudyEducational Media International, 1989
- Quantitative Methods for Assessing the Fit Between Test and CurriculumApplied Measurement in Education, 1989
- AN ANALYSIS OF MANAGEMENT TRAINING VIA TELECOMMUNICATIONSJournal of European Industrial Training, 1988
- The Delphi Method: Techniques and ApplicationsTechnometrics, 1976