Brian Sheppard
Brian Sheppard has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Grayson L. Baird
Brown University
4 shared publications - Michael A. Bruno
Department of Radiology , Penn State Health Milton S. Hershey Medical Center , Hershey , PA , USA
4 shared publications - Michael H. Bernstein
Brown University
4 shared publications Parker S. Lay
The Brown Radiology, Psychology, and Law Lab
2 shared publications- Cristian Jardon
Wilbur Wright College
1 shared publication Elizabeth C. Song
Brown Radiology, Psychology, and Law Lab, Providence, RI, USA
1 shared publication
Latest Publications
- Open Access
An Experimental Investigation of the Relationship between AI-Human Workflow Design and Legal Liability for Radiologists: The Erroneous-Change Penalty and Omission Bias
Background: With growing impetus to integrate artificial intelligence (AI) tools into radiology, clinical practices must navigate workflow redesign. This carries implications for medical malpractice liability. Methods: We conducted an online vignette experiment with United States adults who acted as hypothetical jurors in a malpractice case involving a missed intracranial hemorrhage. Participants (n=2,347) were randomized to one of 22 conditions: a no-AI control and 21 conditions involving a hypothetical AI system. These twenty-one conditions varied by whether (1) a single-read or double-read workflow was used, (2) the radiologist’s initial interpretation was documented, (3) the radiologist changed their interpretation after viewing AI output, (4) the AI detected the abnormality, and (5) the AI error rate—False Discovery Rate (FDR) or False Omission Rate (FOR)—was provided to participants only, both participants and radiologist, or neither. The primary outcome was perceived liability, assessed by whether the radiologist met their duty of care. Findings: Perceived liability differed across conditions (p<0.0001). Double-read workflows (p<0.0001), documenting initial interpretations (p=0.0125), and providing participants with AI error rates, including the FDR (p=0.0038) or FOR (p=0.0035), reduced perceived liability. Liability was also lower when AI was incorrect (p<0.0001). Radiologists’ awareness of AI error rates did not significantly impact liability. Notably, we observed an “erroneous change penalty”: the greatest liability occurred when radiologists initially identified an abnormality but later changed their interpretation to normal after seeing that AI identified the case as normal; conversely, perceived liability was lowest with documented, double-read workflows. Interpretation: Double-read workflows with documented initial interpretations and disclosure of AI error rates reduce perceived liability, though changing a correct initial interpretation increases it. Strategic workflow design is critical for successful AI implementation that can mitigate malpractice risk. RESEARCH IN CONTEXT: Evidence before this study: Emerging research has identified several factors that shape how artificial intelligence (AI) systems are integrated into clinical workflows. Beyond technical performance, factors such as disease prevalence, documentation practices, and workflow design have all been shown to play a role in the implementation of AI tools and how they will inevitably affect physician liability. Vignette experiments have separately identified cognitive biases and mitigating measures that can be integrated into workflow design, such as disclosing AI error rates and documenting independent interpretations before reviewing AI output. Added value of this study: This study builds on prior work by examining how multiple aspects of AI implementation influence perceptions of legal liability when hypothetical jurors are asked to adjudicate a medical malpractice lawsuit arising from a false negative interpretation. In particular, we show how combining double-read workflows, documentation practices, and the inclusion of AI error rates can reduce perceived liability. We also show that, when a double-read workflow is used, changing an initially correct interpretation to an incorrect one incurs greater liability for the radiologist than being incorrect in both the initial and final interpretations. These findings underscore the need to address cognitive biases that will undoubtedly arise at the human-AI interface. Implications of all the available evidence: Optimizing the integration of AI tools into radiology requires strategic attention to workflow redesign, as combinations of features can collectively affect perceived liability, likely through well-known cognitive biases. Based on the results of our study, we propose one workflow that can mitigate a radiologist’s risk of legal liability. Moving forward, clinical practices and stakeholders should remain cognizant of these factors as they work toward building sustainable AI-physician systems.
Open AccessAn Experimental Investigation of the Relationship between AI-Human Workflow Design and Legal Liability for Radiologists: The Erroneous-Change Penalty and Omission Bias
Background: With growing impetus to integrate artificial intelligence (AI) tools into radiology, clinical practices must navigate workflow redesign. This carries implications for medical malpractice liability. Methods: We conducted an online vignette experiment with United States adults who acted as hypothetical jurors in a malpractice case involving a missed intracranial hemorrhage. Participants (n=2,347) were randomized to one of 22 conditions: a no-AI control and 21 conditions involving a hypothetical AI system. These twenty-one conditions varied by whether (1) a single-read or double-read workflow was used, (2) the radiologist’s initial interpretation was documented, (3) the radiologist changed their interpretation after viewing AI output, (4) the AI detected the abnormality, and (5) the AI error rate—False Discovery Rate (FDR) or False Omission Rate (FOR)—was provided to participants only, both participants and radiologist, or neither. The primary outcome was perceived liability, assessed by whether the radiologist met their duty of care. Findings: Perceived liability differed across conditions (p<0.0001). Double-read workflows (p<0.0001), documenting initial interpretations (p=0.0125), and providing participants with AI error rates, including the FDR (p=0.0038) or FOR (p=0.0035), reduced perceived liability. Liability was also lower when AI was incorrect (p<0.0001). Radiologists’ awareness of AI error rates did not significantly impact liability. Notably, we observed an “erroneous change penalty”: the greatest liability occurred when radiologists initially identified an abnormality but later changed their interpretation to normal after seeing that AI identified the case as normal; conversely, perceived liability was lowest with documented, double-read workflows. Interpretation: Double-read workflows with documented initial interpretations and disclosure of AI error rates reduce perceived liability, though changing a correct initial interpretation increases it. Strategic workflow design is critical for successful AI implementation that can mitigate malpractice risk. RESEARCH IN CONTEXT: Evidence before this study: Emerging research has identified several factors that shape how artificial intelligence (AI) systems are integrated into clinical workflows. Beyond technical performance, factors such as disease prevalence, documentation practices, and workflow design have all been shown to play a role in the implementation of AI tools and how they will inevitably affect physician liability. Vignette experiments have separately identified cognitive biases and mitigating measures that can be integrated into workflow design, such as disclosing AI error rates and documenting independent interpretations before reviewing AI output. Added value of this study: This study builds on prior work by examining how multiple aspects of AI implementation influence perceptions of legal liability when hypothetical jurors are asked to adjudicate a medical malpractice lawsuit arising from a false negative interpretation. In particular, we show how combining double-read workflows, documentation practices, and the inclusion of AI error rates can reduce perceived liability. We also show that, when a double-read workflow is used, changing an initially correct interpretation to an incorrect one incurs greater liability for the radiologist than being incorrect in both the initial and final interpretations. These findings underscore the need to address cognitive biases that will undoubtedly arise at the human-AI interface. Implications of all the available evidence: Optimizing the integration of AI tools into radiology requires strategic attention to workflow redesign, as combinations of features can collectively affect perceived liability, likely through well-known cognitive biases. Based on the results of our study, we propose one workflow that can mitigate a radiologist’s risk of legal liability. Moving forward, clinical practices and stakeholders should remain cognizant of these factors as they work toward building sustainable AI-physician systems.
- Open Access
Radiologist-AI workflow can be modified to reduce the risk of medical malpractice claims
Background Artificial Intelligence (AI) is rapidly changing the legal landscape of radiology. Results from a previous experiment suggested that providing AI error rates can reduce perceived radiologist culpability, as judged by mock jury members (4). The current study advances this work by examining whether the radiologist’s behavior also impacts perceptions of liability. Methods. Participants (n=282) read about a hypothetical malpractice case where a 50-year-old who visited the Emergency Department with acute neurological symptoms received a brain CT scan to determine if bleeding was present. An AI system was used by the radiologist who interpreted imaging. The AI system correctly flagged the case as abnormal. Nonetheless, the radiologist concluded no evidence of bleeding, and the blood-thinner t-PA was administered. Participants were randomly assigned to either a 1.) single-read condition, where the radiologist interpreted the CT once after seeing AI feedback, or 2.) a double-read condition, where the radiologist interpreted the CT twice, first without AI and then with AI feedback. Participants were then told the patient suffered irreversible brain damage due to the missed brain bleed, resulting in the patient (plaintiff) suing the radiologist (defendant). Participants indicated whether the radiologist met their duty of care to the patient (yes/no). Results. Hypothetical jurors were more likely to side with the plaintiff in the single-read condition (106/142, 74.7%) than in the double-read condition (74/140, 52.9%), p=0.0002. Conclusion. This suggests that the penalty for disagreeing with correct AI can be mitigated when images are interpreted twice, or at least if a radiologist gives an interpretation before AI is used.
Open AccessRadiologist-AI workflow can be modified to reduce the risk of medical malpractice claims
Background Artificial Intelligence (AI) is rapidly changing the legal landscape of radiology. Results from a previous experiment suggested that providing AI error rates can reduce perceived radiologist culpability, as judged by mock jury members (4). The current study advances this work by examining whether the radiologist’s behavior also impacts perceptions of liability. Methods. Participants (n=282) read about a hypothetical malpractice case where a 50-year-old who visited the Emergency Department with acute neurological symptoms received a brain CT scan to determine if bleeding was present. An AI system was used by the radiologist who interpreted imaging. The AI system correctly flagged the case as abnormal. Nonetheless, the radiologist concluded no evidence of bleeding, and the blood-thinner t-PA was administered. Participants were randomly assigned to either a 1.) single-read condition, where the radiologist interpreted the CT once after seeing AI feedback, or 2.) a double-read condition, where the radiologist interpreted the CT twice, first without AI and then with AI feedback. Participants were then told the patient suffered irreversible brain damage due to the missed brain bleed, resulting in the patient (plaintiff) suing the radiologist (defendant). Participants indicated whether the radiologist met their duty of care to the patient (yes/no). Results. Hypothetical jurors were more likely to side with the plaintiff in the single-read condition (106/142, 74.7%) than in the double-read condition (74/140, 52.9%), p=0.0002. Conclusion. This suggests that the penalty for disagreeing with correct AI can be mitigated when images are interpreted twice, or at least if a radiologist gives an interpretation before AI is used.
- 22 May 2025
- Published by Massachusetts Medical Society in NEJM AI
- Vol. 2 (6)
Randomized Study of the Impact of AI on Perceived Legal Liability for Radiologists
- 22 May 2025
- Published by Massachusetts Medical Society in NEJM AI
- Vol. 2 (6)
Randomized Study of the Impact of AI on Perceived Legal Liability for Radiologists
- Open Access
Just because you’re paranoid doesn’t mean they won’t side with the plaintiff: Examining perceptions of liability about AI in radiology
Background Artificial Intelligence (AI) will have unintended consequences for radiology. When a radiologist misses an abnormality on an image, their liability may differ according to whether or not AI also missed the abnormality. Methods U.S. adults viewed a vignette describing a radiologist being sued for missing a brain bleed (N=652) or cancer (N=682). Participants were randomized to one of five conditions. In four conditions, they were told an AI system was used. Either AI agreed with the radiologist, also failing to find pathology (AI agree) or did find pathology (AI disagree). In the AI agree+FOR condition, AI agreed with the radiologist and an AI false omission rate (FOR) of 1% was presented. In the AI disagree+FDR condition, AI disagreed and an AI false discovery rate (FDR) of 50% was presented. There was also a no AI control condition. Otherwise, vignettes were identical. Participants indicated whether the radiologist met their duty of care as a proxy for whether they would side with defense (radiologist) or plaintiff in trial. Results Participants were more likely to side with the plaintiff in the AI disagree vs. AI agree condition (brain bleed: 72.9% vs. 50.0%, p=0.0054; cancer: 78.7% vs. 63.5%, p=0.00365) and in the AI disagree vs. no AI condition (brain bleed: 72.9% vs. 56.3%, p=0.0054; cancer: 78.7% vs. 65.2%, p=0.00895). Participants were less likely to side with the plaintiff when FDR or FOR were provided: AI disagree vs AI disagree+FDR (brain bleed: 72.9% vs. 48.8%, p=0.00005; cancer: 78.7% vs. 73.1%, p=0.1507), and AI agree vs. AI agree+FOR (brain bleed: 50.0% vs. 34.0%, p=0.0044; cancer: 63.5% vs. 56.4%, p=0.1085). Discussion Radiologists who failed to find an abnormality are viewed as more culpable when they used an AI system that detected the abnormality. Presenting participants with AI accuracy data decreased perceived liability. These findings have relevance for courtroom proceedings.
Open AccessJust because you’re paranoid doesn’t mean they won’t side with the plaintiff: Examining perceptions of liability about AI in radiology
Background Artificial Intelligence (AI) will have unintended consequences for radiology. When a radiologist misses an abnormality on an image, their liability may differ according to whether or not AI also missed the abnormality. Methods U.S. adults viewed a vignette describing a radiologist being sued for missing a brain bleed (N=652) or cancer (N=682). Participants were randomized to one of five conditions. In four conditions, they were told an AI system was used. Either AI agreed with the radiologist, also failing to find pathology (AI agree) or did find pathology (AI disagree). In the AI agree+FOR condition, AI agreed with the radiologist and an AI false omission rate (FOR) of 1% was presented. In the AI disagree+FDR condition, AI disagreed and an AI false discovery rate (FDR) of 50% was presented. There was also a no AI control condition. Otherwise, vignettes were identical. Participants indicated whether the radiologist met their duty of care as a proxy for whether they would side with defense (radiologist) or plaintiff in trial. Results Participants were more likely to side with the plaintiff in the AI disagree vs. AI agree condition (brain bleed: 72.9% vs. 50.0%, p=0.0054; cancer: 78.7% vs. 63.5%, p=0.00365) and in the AI disagree vs. no AI condition (brain bleed: 72.9% vs. 56.3%, p=0.0054; cancer: 78.7% vs. 65.2%, p=0.00895). Participants were less likely to side with the plaintiff when FDR or FOR were provided: AI disagree vs AI disagree+FDR (brain bleed: 72.9% vs. 48.8%, p=0.00005; cancer: 78.7% vs. 73.1%, p=0.1507), and AI agree vs. AI agree+FOR (brain bleed: 50.0% vs. 34.0%, p=0.0044; cancer: 63.5% vs. 56.4%, p=0.1085). Discussion Radiologists who failed to find an abnormality are viewed as more culpable when they used an AI system that detected the abnormality. Presenting participants with AI accuracy data decreased perceived liability. These findings have relevance for courtroom proceedings.
- Open Access
- 8 June 2023
- Published by California State University, Office of the Chancellor in The PUMP Journal of Undergraduate Research
- Vol. 6, 224-249
A Motion Planning Algorithm in a Figure Eight Track
We design a motion planning algorithm to coordinate the movements of two robots along a figure eight track, in such a way that no collisions occur. We use a topological approach to robot motion planning that relates instabilities in motion planning algorithms to topological features of configuration spaces. The topological complexity of a configuration space is an invariant that measures the complexity of motion planning algorithms. We show that the topological complexity of our problem is 3 and construct an explicit algorithm with three continuous instructions
- 8 June 2023
- Published by California State University, Office of the Chancellor in The PUMP Journal of Undergraduate Research
- Vol. 6, 224-249
Open AccessA Motion Planning Algorithm in a Figure Eight Track
We design a motion planning algorithm to coordinate the movements of two robots along a figure eight track, in such a way that no collisions occur. We use a topological approach to robot motion planning that relates instabilities in motion planning algorithms to topological features of configuration spaces. The topological complexity of a configuration space is an invariant that measures the complexity of motion planning algorithms. We show that the topological complexity of our problem is 3 and construct an explicit algorithm with three continuous instructions
- Open Access
- 1 January 2013
- Published by Elsevier in SSRN Electronic Journal
Norm Supercompliance and the Status of Soft Law
Recent empirical research, including my own, has exposed a previously overlooked behavior: instances in which people constrain themselves from doing something t
- 1 January 2013
- Published by Elsevier in SSRN Electronic Journal
Open AccessNorm Supercompliance and the Status of Soft Law
Recent empirical research, including my own, has exposed a previously overlooked behavior: instances in which people constrain themselves from doing something t