Human Versus Artificial Intelligence: A Data-Driven Approach to Real-Time Process Management During Complex Engineering Design
Open Access
- 14 October 2021
- journal article
- research article
- Published by Wiley in Journal of Mechanical Design
- Vol. 144 (2)
Abstract
Managing the design process of teams has been shown to considerably improve problem-solving behaviors and resulting final outcomes. Automating this activity presents significant opportunities in delivering interventions that dynamically adapt to the state of a team in order to reap the most impact. In this work, an artificial intelligence (AI) agent is created to manage the design process of engineering teams in real time, tracking features of teams’ actions and communications during a complex design and path-planning task in multidisciplinary teams. Teams are also placed under the guidance of human process managers for comparison. Regarding outcomes, teams perform equally as well under both types of management, with trends toward even superior performance from the AI-managed teams. The managers’ intervention strategies and team perceptions of those strategies are also explored, illuminating some intriguing similarities. Both the AI and human process managers focus largely on communication-based interventions, though differences start to emerge in the distribution of interventions across team roles. Furthermore, team members perceive the interventions from both the AI and human manager as equally relevant and helpful, and believe the AI agent to be just as sensitive to the needs of the team. Thus, the overall results show that the AI manager agent introduced in this work is able to match the capabilities of humans, showing potential in automating the management of a complex design process.Keywords
Funding Information
- Air Force Office of Scientific Research (FA9550-18-1-0088)
- Defense Advanced Research Projects Agency (N66001-17-1-4064)
This publication has 33 references indexed in Scilit:
- Performance Pressure as a Double-edged SwordAdministrative Science Quarterly, 2012
- Collaborative Creativity—Group Creativity and Team Innovation2012
- An Empirical Study of Information Flows in Multidisciplinary Civil Engineering Design Teams using Lean MeasuresArchitectural Engineering and Design Management, 2011
- Design Team Communication and Design Task Complexity: The Preference for DialoguesArchitectural Engineering and Design Management, 2008
- The Effects of Team Diversity on Team Outcomes: A Meta-Analytic Review of Team DemographyJournal of Management, 2007
- Team Diversity and Information UseAcademy of Management Journal, 2005
- A Document Analysis Method for Characterizing Design Team PerformanceJournal of Mechanical Design, 2003
- An introduction to latent semantic analysisDiscourse Processes, 1998
- The Virtual Design Team: Modeling organizational behavior of concurrent design teamsArtificial Intelligence for Engineering Design, Analysis and Manufacturing, 1995
- Training to Reduce the Disruptive Effects of InterruptionsProceedings of the Human Factors and Ergonomics Society Annual Meeting, 1994