Subjects' Reactions to Computer-Based Tests
Author:
- 1 March 1999
- journal article
- research article
- Published by SAGE Publications in Journal of Educational Technology Systems
- Vol. 27 (3) , 195-206
Abstract
This article reports the reactions of subjects who completed an attitudinal questionnaire after taking a battery of computer-based tests. The research focus concerned gauging reactions to innovative test types—where considerably more was demanded of subjects than merely a multiple-choice keyboard stroke. This article argues that “consumer validity”—subjects' attitudes and feelings toward a test—is an important factor in test design, since, if it is ignored, there may well be adverse effects on test scores. “Consumer validity” in the current study has therefore been operationalised as a score of 66 percent positive reaction on attitudinal questions. The study illustrates that although subjects participating in the study were familiar with computers, their reactions to the tests were mixed. On a number of questions—such as readiness for the test, preference for test medium and enjoying taking the test—the threshold of 66 percent was not always reached. The article ends with a note of caution with regard to computer-based testing, arguing that if subjects are not clear about what to do in a computer-based test, or cannot perform as well through the medium of the computer as they can on pen and paper, then the test will not be delivering optimum results—with corresponding implications as to the reliability of the results.Keywords
This publication has 13 references indexed in Scilit:
- Interactive Evaluation of Listening Comprehension: How the Context May HelpComputer Assisted Language Learning, 1998
- A COMPUTERISED ENGLISH LANGUAGE PROOFING CLOZE PROGRAMComputer Assisted Language Learning, 1997
- A Study of Word Processing Experience and its Effects on Student Essay WritingJournal of Educational Computing Research, 1996
- A general measure of user computing satisfactionComputers in Human Behavior, 1996
- Towards a common ability scale for Hong Kong English secondary-school formsLanguage Testing, 1995
- Computer anxiety correlates and what they tell us: A literature reviewComputers in Human Behavior, 1994
- The Experience Factor in Computer Anxiety and InterestJournal of Educational Technology Systems, 1992
- Test-takers' reactions to a placement testLanguage Testing, 1990
- Research on the Effects of Administering Tests via ComputersEducational Measurement: Issues and Practice, 1989
- On taking language testsLanguage Testing, 1984