Evaluating Public Plans for AI Systems: Comparing Premortem and Promortems
- 12 November 2026
- journal article
- Published by SAGE Publications in Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Abstract
Effective planning requires anticipating risks before they occur, yet planners often underestimate potential failures due to optimism bias. This research compared three reasoning techniques—critique, premortem, and promortem—for evaluating a proposed automated high-speed rail plan across two experiments (individual, N = 108; group, N = 30). Participants rated their confidence and understanding of the plan before and after generating reasons, then generated potential solutions. Premortem reasoning reduced participants’ confidence in the plan and then supported confidence recovery once solutions were generated, whereas promortem reasoning increased confidence throughout the session, consistent with optimism bias; effects were more pronounced in group settings. Critique and premortem elicited a higher proportion of reasons and solutions related to the plan’s AI than promortem. Findings support the premortem as a tool for calibrating confidence and generating actionable, domain-relevant risks during early-stage technology planning.This publication has 13 references indexed in Scilit:
- Proactive planning for contextual fit: the role of the implementation premortemImplementation Science Communications, 2025
- Teaching to Fail (Before It Happens): Premortem as a Pedagogical Strategy in HCI Education2025
- Premortems in Game Development Teams: Impact and PotentialProceedings of the Human Factors and Ergonomics Society Annual Meeting, 2023
- Identifying and Addressing Risks in the Early Design of a Sociotechnical System through PremortemProceedings of the Human Factors and Ergonomics Society Annual Meeting, 2022
- Human Factors Methods2017
- Why Near‐Miss Events Can Decrease an Individual's Protective Response to HurricanesRisk Analysis, 2010
- Exploring the "planning fallacy": Why people underestimate their task completion times.Journal of Personality and Social Psychology, 1994
- New “Brainstorming” PrinciplesAustralian Journal of Management, 1994
- Effects of devil's advocacy and dialectical inquiry on decision making: A meta-analysisOrganizational Behavior and Human Decision Processes, 1990
- Reasons for confidence.Journal of Experimental Psychology: Human Learning and Memory, 1980