AI in the Hands of Imperfect Users

Authors

Kristin M Kostick-Quenet
Sara Gerke

Language

English

Publication Date

12-28-2022

Journal

NPJ Digital Medicine

DOI

10.1038/s41746-022-00737-z

PMID

36577851

PMCID

PMC9795935

PubMedCentral® Posted Date

12-28-2022

PubMedCentral® Full Text Version

Post-print

Abstract

As the use of artificial intelligence and machine learning (AI/ML) continues to expand in healthcare, much attention has been given to mitigating bias in algorithms to ensure they are employed fairly and transparently. Less attention has fallen to addressing potential bias among AI/ML's human users or factors that influence user reliance. We argue for a systematic approach to identifying the existence and impacts of user biases while using AI/ML tools and call for the development of embedded interface design features, drawing on insights from decision science and behavioral economics, to nudge users towards more critical and reflective decision making using AI/ML.

Keywords

Ethics, Medical ethics

Published Open-Access

yes

Recommended Citation

Kristin M Kostick-Quenet and Sara Gerke, "AI in the Hands of Imperfect Users" (2022). Center for Medical Ethics and Health Policy Staff Publications. 297.
https://digitalcommons.library.tmc.edu/med_ethics/297