On the Measurement of Ideation Quality
- 1 May 2007
- journal article
- Published by Taylor & Francis in Journal of Management Information Systems
- Vol. 23 (4) , 143-161
Abstract
Ideation is a key step in organizational problem solving, so researchers have developed a variety of technological interventions for improving ideation quality, which we define as the degree to which an ideation activity produces ideas that are helpful in attaining a goal. In this paper, we examine the four measures typically used to evaluate ideation quality, including idea-count, sum-of-quality, average-quality, and good-idea-count, and discuss their validity and potential biases. An experimental study comparing three levels of social comparison was used to illustrate the differences in the ideation quality measures and revealed that research conclusions were dependent on the measure used. Based on our analysis of the measures and experimental results, we recommend that only good-idea-count be used as a measure to evaluate ideation treatments and call into question research that has based its findings on the other measures. Finally, we discuss implications for research and other potential approaches to ...Keywords
This publication has 37 references indexed in Scilit:
- Idea Generation in Computer-Based Groups: A New Ending to an Old StoryOrganizational Behavior and Human Decision Processes, 1994
- Self-efficacy theory: Implications for social facilitation and social loafing.Journal of Personality and Social Psychology, 1992
- Productivity loss in idea-generating groups: Tracking down the blocking effect.Journal of Personality and Social Psychology, 1991
- The Effects of Anonymity on GDSS Group Process With an Idea-Generating TaskMIS Quarterly, 1990
- Effects of task difficulty and task uniqueness on social loafing.Journal of Personality and Social Psychology, 1982
- Effects of anticipated evaluation on individual brainstorming performance.Journal of Applied Psychology, 1980
- Comparison of a written feedback procedure, group brainstorming, and individual brainstorming.Journal of Applied Psychology, 1978
- Brainstorming by individuals, coacting and interacting groups.Journal of Applied Psychology, 1974
- Size, performance, and potential in brainstorming groups.Journal of Applied Psychology, 1970
- Group and individual effects in problem solving.Journal of Applied Psychology, 1969