Multiple Informant Methodology: A Critical Review and Recommendations
- 1 May 2010
- journal article
- review article
- Published by SAGE Publications in Sociological Methods & Research
- Vol. 38 (4) , 582-618
Abstract
The value of multiple informant methodology for improving the validity in determining organizational properties has been increasingly recognized. However, the majority of empirical research still relies on single (key) informants. This is partly due to the lack of comprehensive methodological narratives and precise recommendations on the application of this important methodology. Therefore, the authors have developed a critical review and derived clear recommendations for the key challenges that researchers face in using multiple informants: (1) Which and how many informants should be considered? (2) How should the consensus among the informants be judged? (3) How are multiple responses combined into a single, organizational response to conduct further data analyses?Keywords
This publication has 68 references indexed in Scilit:
- Buyer-Supplier Collaboration in Product Development ProjectsJournal of Management, 2005
- Multiple Voices of Modernization: Some Methodological ImplicationsPublic Administration, 2004
- Estimating Interrater Agreement with the Average Deviation Index: A User’s GuideOrganizational Research Methods, 2002
- Belaboring the Not-So-Obvious: Consensus, Commitment, and Strategy Implementation Speed and SuccessJournal of Management, 2000
- A Revised Index of Interrater Agreement for Multi-Item Ratings of a Single TargetApplied Psychological Measurement, 1999
- Performance of a composite as a function of the number of judgesOrganizational Behavior and Human Performance, 1978
- A Note on Estimating the Reliability of Categorical DataEducational and Psychological Measurement, 1970
- Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.Psychological Bulletin, 1968
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960
- The Informant in Quantitative ResearchAmerican Journal of Sociology, 1955