Skip to main content

Implementing AI in Healthcare: Bridging the Gap Between Technical, Cognitive, and Sociotechnical Perspectives

Implementing AI in Healthcare: Bridging the Gap Between Technical, Cognitive, and Sociotechnical Perspectives

The implementation of clinical decision support (CDS) tools is notoriously challenging. Safely, effectively, and equitably incorporating AI into CDS implementations holds the promise of improving precision and appropriateness of CDS, providing improved information synthesis, and reducing clinical cognitive burden. AI-specific barriers exacerbate CDS implementation hurdles. The effectiveness of AI-enhanced CDS tools in actual clinical settings remains underexplored, with limited evidence: (i) few randomized clinical trials have assessed the impacts of AI-enabled CDS in clinical care, and (ii) there are few no studies of employing AI to enhance the design and analysis of cognitive-socio-technical systems relevant to conventional CDS implementations. Yet, clinical trials of AI-enabled CDS will not provide sufficient information for implementation. Sociotechnical approaches are crucial to understand the complex personal, technical, work system, and broad societal implications of AI in clinical care. Proposed sociotechnical strategies include seeking clinician feedback from design through implementation and sustainment phases for AI-based approaches in CDS systems.

SCOPE

There's a notable gap in sociotechnical research focusing on the clinician's experience with AI systems, particularly regarding the integration of data visualizations to support their decision-making. Many sociotechnical studies of AI-based systems have focused on patient end users, but there is a need for additional clinician studies for CDS users that evaluate information synthesis needs, effective incorporating data summarization and visualizations, and assessments of the changes in the data and clinical environment that the CDS itself produces beyond the targeted action. Effective interventions that support better decision-making can be bolstered with design and evaluation that incorporates cognitive theories.as well as social theories that recognize healthcare data as one part of a complex organizational system. A commonly used One example from cognitive psychology is dual-process theory which categorizes thinking processes – that which are intuitive and fast (system 1) or deliberate and slow (system 2). Dual-process theory does not map well to neurological processes, for that, approaches related to cognitive control may be better. Social science theories may also have an important role to play in helping us to conceptualize modern healthcare environments as complex dynamic systems that are actively shaped by tool users, tool designers, and tools themselves. In addition to these complexities, it is critical that AI-assisted CDS also be considered, assessed, and continuously evaluated for fairness and equity within clinically and culturally relevant sub-groups that may have differential care goals and needs.

TOPICS

  • Healthcare AI implementation and sustainability
  • Approaches to distributed cognition
  • AI-driven early warning scores and acceptability
  • Individual differences and implications for AI implementation - attention and motivation
  • Sociotechnical & cognitive evaluation approaches to AI models
  • AI in context
  • Workflow for AI incorporation
  • Evaluating the sustainability of clinical use cases and organizational settings for specific AI-based CDS solutions
  • Trust in AI and sociotechnical design
 

PROGRAM

Time

Format

Topic

Speakers

5 minutes

Podium presentation 

Welcome address

Jorie Butler

40 Minutes

Podium presentation

Opening Keynote

Michael Matheny

60 minutes

Research presentation

Various research topics on using novel AI/ML methods

James Cai

15 minutes

Break

Connect and collaborate

N/A

60 minutes

Research presentation

Various research topics on using novel AI/ML methods

Communication author of 3 to 4 accepted papers

30 minutes

Interactive panel

Q&A on AI on research topics

TBN

20 minutes

Podium talk

Closing Keynote

TBN

scientific paper PROGRAM Committee

Peter Taber, PhD
Research Assistant Professor, Biomedical Informatics University of Utah
Jorie Butler, PhD
Associate Professor, Biomedical Informatics University of Utah
Michael E. Matheny, MD, MS, MPH, FACMI
Professor, Department of Biomedical Informatics, Biostatistics, and Medicine Vanderbilt University Medical Center
Aref Smiley, PhD
Research Assistant Professor, Biomedical Informatics University of Utah