Improving the question formulation in Delphi‐like surveys: Analysis of the effects of abstract language and amount of information on response behavior
Open Access
- 27 August 2020
- journal article
- research article
- Published by Wiley in FUTURES & FORESIGHT SCIENCE
- Vol. 3 (1)
Abstract
Prospective surveys are a common research mode used to establish a profound decision base for R&D investments, technological innovation, and policy making. The challenge faced by participants of such surveys, particularly if conducted via impersonal survey modes (e.g., mail or online surveys), is the limited ability to clarify contextual issues. Related research in socio‐psychology refers to language vagueness as abstractness, cautioning that abstract language and the way people interpret information are related. We apply Construal Level Theory and the Linguistic Category Model from linguistic sciences to the context of prospective surveys and examine the effects of abstract language and its related amount of information on panelists' response behavior. Based upon 32,000 observations, our research reveals that higher abstractness and greater amount of information reduce the clarity of the respondents' assessments of survey questions. In particular, abstract language and lengthy questions lead to less extreme assessments and a reduced response variance of panelists.Keywords
This publication has 160 references indexed in Scilit:
- Quantifying the development of agreement among experts in Delphi studiesTechnological Forecasting and Social Change, 2013
- Frailty Consensus: A Call to ActionJournal of the American Medical Directors Association, 2013
- Rising to the challenges—Reflections on Future-oriented Technology AnalysisTechnological Forecasting and Social Change, 2013
- Quantitative and qualitative approaches in Future-oriented Technology Analysis (FTA): From combination to integration?Technological Forecasting and Social Change, 2013
- Increasing web survey response rates in innovation research: An experimental study of static and dynamic contact design featuresResearch Policy, 2013
- Bottom-up estimation of industrial and public R&D investment by technology in support of policy-making: The case of selected low-carbon energy technologiesResearch Policy, 2012
- Using the Delphi method to engage stakeholders: A comparison of two studiesEvaluation and Program Planning, 2010
- When the glass is half full and half empty: CEOs' ambivalent interpretations of strategic issuesStrategic Management Journal, 2009
- Surviving Sepsis Campaign: International guidelines for management of severe sepsis and septic shock: 2008Intensive Care Medicine, 2007
- The Directionality of Verbal Probability Expressions: Effects on Decisions, Predictions, and Probabilistic ReasoningOrganizational Behavior and Human Decision Processes, 1999