Adequacy of Reporting Results of School Surveys and Nonresponse Effects: A Review of the Literature and a Case Study
Authors:
- 1 November 2008
- journal article
- review article
- Published by American Educational Research Association (AERA) in Educational Researcher
- Vol. 37 (8) , 480-490
Abstract
To ensure accurate interpretation of research findings, researchers should report details about their research design, data collection method, and response rates when presenting findings from survey research. A review of 100 peer-reviewed articles reporting the results of survey research on K–12 schools with principals as the designated respondents revealed that such information is often not reported. Few studies examined or even acknowledged the potentially biasing effects of nonresponse. A mail survey of 470 schools in California, which yielded a response rate of 33% (157/470), is used as a case study to evaluate the pattern of nonresponse and its effects on univariate and multivariate statistics. Consistent with prior research, nonresponse produced bias in univariate estimates, but associations between variables were robust and not affected.Keywords
This publication has 24 references indexed in Scilit:
- From the Editor: Nonresponse and Generalizability in Academic ResearchJournal of the Academy of Marketing Science, 2006
- Nonresponse Rates and Nonresponse Bias in Household SurveysPublic Opinion Quarterly, 2006
- Principals’ Perceptions and Practices of School Bullying Prevention ActivitiesHealth Education & Behavior, 2004
- The Role of Topic Interest in Survey Participation DecisionsPublic Opinion Quarterly, 2004
- The handling of nonresponse errorHuman Resource Development Quarterly, 2003
- Beyond Interdisciplinary Teaming: Findings and Implications of the NASSP National Middle Level StudyNASSP Bulletin, 2002
- Likelihood of Participating in Mail Survey ResearchIndustrial Marketing Management, 2000
- The Effects of Response Rate Changes on the Index of Consumer SentimentPublic Opinion Quarterly, 2000
- The Effects of Expanded Donor Choice in United Way Campaigns on Nonprofit Human Service Providers in the Washington, D.C., Metropolitan AreaNonprofit and Voluntary Sector Quarterly, 1999
- Further Evidence on Factors Affecting Response Rates to Mailed QuestionnairesAmerican Sociological Review, 1982