Oliver C. Mudford
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Oliver C. Mudford has a total of 12 co-authors. Here are the top co-authors by number of shared publications:
Jason R. Zeleny
University of Nebraska Medical Center's Munroe‐Meyer Institute Omaha NE 68198‐5450 USA
2 shared publications- Katrina J. Phillips
University of Auckland, Auckland, New Zealand
2 shared publications Neil T. Martin
2 shared publicationsSarah Ann Taylor
2 shared publications- Douglas Elliffe
The University of Auckland Auckland New Zealand
1 shared publication - Janine M. Locke
The University of Auckland, Private Bag 92019, Auckland 1142, New Zealand
1 shared publication
Latest Publications
- 19 August 2014
- Published by Wiley in Behavioral Interventions
- Vol. 29 (4) , 315-330
USING CALIBRATION AND INTEROBSERVER AGREEMENT ALGORITHMS TO ASSESS THE ACCURACY AND PRECISION OF DATA FROM ELECTRONIC AND PEN‐AND‐PAPER CONTINUOUS RECORDING METHODS
Often it is assumed that electronic recording by observers necessarily provides better quality data than pen‐and‐paper methods. Fifteen novice observers recorded rates of responding from 10 role‐played video samples using one of three continuous recording input formats: keyboard (laptop), touchscreen (personal digital assistants), or pen‐and‐paper. We evaluated the quality of the observers' data compared with criterion records using calibration and interobserver agreement algorithms. Results of the calibration analysis revealed that observers in the touchscreen group produced the most consistently accurate and precise data, the keyboard group observers showed wide variation in precision and accuracy, and the pen‐and‐paper group observers were significantly less precise than the touchscreen group. We conclude that although electronic recording has the potential to be as accurate as, and more precise than, pen‐and‐paper methods, this is far from guaranteed. Analyses of observers' errors advise recommendations for improving data accuracy and precision when using each method. Copyright © 2014 John Wiley & Sons, Ltd.
- 19 August 2014
- Published by Wiley in Behavioral Interventions
- Vol. 29 (4) , 315-330
USING CALIBRATION AND INTEROBSERVER AGREEMENT ALGORITHMS TO ASSESS THE ACCURACY AND PRECISION OF DATA FROM ELECTRONIC AND PEN‐AND‐PAPER CONTINUOUS RECORDING METHODS
Often it is assumed that electronic recording by observers necessarily provides better quality data than pen‐and‐paper methods. Fifteen novice observers recorded rates of responding from 10 role‐played video samples using one of three continuous recording input formats: keyboard (laptop), touchscreen (personal digital assistants), or pen‐and‐paper. We evaluated the quality of the observers' data compared with criterion records using calibration and interobserver agreement algorithms. Results of the calibration analysis revealed that observers in the touchscreen group produced the most consistently accurate and precise data, the keyboard group observers showed wide variation in precision and accuracy, and the pen‐and‐paper group observers were significantly less precise than the touchscreen group. We conclude that although electronic recording has the potential to be as accurate as, and more precise than, pen‐and‐paper methods, this is far from guaranteed. Analyses of observers' errors advise recommendations for improving data accuracy and precision when using each method. Copyright © 2014 John Wiley & Sons, Ltd.
- 9 October 2011
- Published by Wiley in Behavioral Interventions
- Vol. 26 (4) , 282-308
Training Employment Acquisition Skills for Adolescents with a Substance Abuse History
- 9 October 2011
- Published by Wiley in Behavioral Interventions
- Vol. 26 (4) , 282-308
Training Employment Acquisition Skills for Adolescents with a Substance Abuse History
- 1 September 2011
- Published by Wiley in Journal of Applied Behavior Analysis
- Vol. 44 (3) , 571-586
CALIBRATION OF OBSERVATIONAL MEASUREMENT OF RATE OF RESPONDING
The quality of measurement systems used in almost all natural sciences other than behavior analysis is usually evaluated through calibration study rather than relying on interobserver agreement. We demonstrated some of the basic features of calibration using observer-measured rates of free-operant responding from 10 scripted 10-min calibration samples on video. Five novice and 5 experienced observers recorded (on laptop computers) response samples with a priori determined response rates ranging from 0 to 8 responses per minute. Observer records were then compared with these predetermined reference values using linear regression and related graphical depiction. Results indicated that all of the observers recorded rates that were accurate to within ±0.4 responses per minute and 5 were accurate to within ±0.1 responses per minute, indicating that continuous recording of responding on computers can be highly accurate and precise. Additional research is recommended to investigate conditions that affect the quality of direct observational measurement of behavior.
- 1 September 2011
- Published by Wiley in Journal of Applied Behavior Analysis
- Vol. 44 (3) , 571-586
CALIBRATION OF OBSERVATIONAL MEASUREMENT OF RATE OF RESPONDING
The quality of measurement systems used in almost all natural sciences other than behavior analysis is usually evaluated through calibration study rather than relying on interobserver agreement. We demonstrated some of the basic features of calibration using observer-measured rates of free-operant responding from 10 scripted 10-min calibration samples on video. Five novice and 5 experienced observers recorded (on laptop computers) response samples with a priori determined response rates ranging from 0 to 8 responses per minute. Observer records were then compared with these predetermined reference values using linear regression and related graphical depiction. Results indicated that all of the observers recorded rates that were accurate to within ±0.4 responses per minute and 5 were accurate to within ±0.1 responses per minute, indicating that continuous recording of responding on computers can be highly accurate and precise. Additional research is recommended to investigate conditions that affect the quality of direct observational measurement of behavior.
- 3 January 2011
- Published by Wiley in Behavioral Interventions
- Vol. 26 (1) , 41-49
Rates of responding measured by continuous recording in applied behavioral research
- 3 January 2011
- Published by Wiley in Behavioral Interventions
- Vol. 26 (1) , 41-49
Rates of responding measured by continuous recording in applied behavioral research
- 1 September 2009
- Published by Wiley in Journal of Applied Behavior Analysis
- Vol. 42 (3) , 527-539
ASSESSING OBSERVER ACCURACY IN CONTINUOUS RECORDING OF RATE AND DURATION: THREE ALGORITHMS COMPARED
The three algorithms most frequently selected by behavior‐analytic researchers to compute interobserver agreement with continuous recording were used to assess the accuracy of data recorded from video samples on handheld computers by 12 observers. Rate and duration of responding were recorded for three samples each. Data files were compared with criterion records to determine observer accuracy. Block‐by‐block and exact agreement algorithms were susceptible to inflated agreement and accuracy estimates at lower rates and durations. The exact agreement method appeared to be overly stringent for recording responding at higher rates (23.5 responses per minute) and for higher relative duration (72% of session). Time‐window analysis appeared to inflate accuracy assessment at relatively high but not at low response rate and duration (4.8 responses per minute and 8% of session, respectively).
- 1 September 2009
- Published by Wiley in Journal of Applied Behavior Analysis
- Vol. 42 (3) , 527-539
ASSESSING OBSERVER ACCURACY IN CONTINUOUS RECORDING OF RATE AND DURATION: THREE ALGORITHMS COMPARED
The three algorithms most frequently selected by behavior‐analytic researchers to compute interobserver agreement with continuous recording were used to assess the accuracy of data recorded from video samples on handheld computers by 12 observers. Rate and duration of responding were recorded for three samples each. Data files were compared with criterion records to determine observer accuracy. Block‐by‐block and exact agreement algorithms were susceptible to inflated agreement and accuracy estimates at lower rates and durations. The exact agreement method appeared to be overly stringent for recording responding at higher rates (23.5 responses per minute) and for higher relative duration (72% of session). Time‐window analysis appeared to inflate accuracy assessment at relatively high but not at low response rate and duration (4.8 responses per minute and 8% of session, respectively).
- 1 March 2009
- Published by Wiley in Journal of Applied Behavior Analysis
- Vol. 42 (1) , 165-169
CONTINUOUS RECORDING AND INTEROBSERVER AGREEMENT ALGORITHMS REPORTED IN THE JOURNAL OF APPLIED BEHAVIOR ANALYSIS (1995–2005)
We reviewed all research articles in 10 recent volumes of the Journal of Applied Behavior Analysis (JABA): Vol. 28(3), 1995, through Vol. 38(2), 2005. Continuous recording was used in the majority (55%) of the 168 articles reporting data on free‐operant human behaviors. Three methods for reporting interobserver agreement (exact agreement, block‐by‐block agreement, and time‐window analysis) were employed in more than 10 of the articles that reported continuous recording. Having identified these currently popular agreement computation algorithms, we explain them to assist researchers, software writers, and other consumers of JABA articles.
- 1 March 2009
- Published by Wiley in Journal of Applied Behavior Analysis
- Vol. 42 (1) , 165-169
CONTINUOUS RECORDING AND INTEROBSERVER AGREEMENT ALGORITHMS REPORTED IN THE JOURNAL OF APPLIED BEHAVIOR ANALYSIS (1995–2005)
We reviewed all research articles in 10 recent volumes of the Journal of Applied Behavior Analysis (JABA): Vol. 28(3), 1995, through Vol. 38(2), 2005. Continuous recording was used in the majority (55%) of the 168 articles reporting data on free‐operant human behaviors. Three methods for reporting interobserver agreement (exact agreement, block‐by‐block agreement, and time‐window analysis) were employed in more than 10 of the articles that reported continuous recording. Having identified these currently popular agreement computation algorithms, we explain them to assist researchers, software writers, and other consumers of JABA articles.