The quality and safety of using generative AI to produce patient-centred discharge instructions.

Stanceski, K; Zhong, S; Zhang, X; Khadra, S; Tracy, M; Koria, L; Lo, S; Naganathan, V; Kim, J; Dunn, AG; Ayre, J

The quality and safety of using generative AI to produce patient-centred discharge instructions.

Stanceski, K Zhong, S Zhang, X Khadra, S Tracy, M Koria, L Lo, S Naganathan, V Kim, J Dunn, AG Ayre, J

Permalink

Publisher:: Springer Nature
Publication Type:: Journal Article
Citation:: NPJ Digit Med, 2024, 7, (1), pp. 329
Issue Date:: 2024-11-20

Open Access

Copyright Clearance Process

Recently Added
In Progress
Open Access

This item is open access.

Adobe PDF

Download Published versionAdobe PDF (798.52 kB)

View on publisher's site

View statistics

Full metadata record

Field	Value	Language
dc.contributor.author	Stanceski, K
dc.contributor.author	Zhong, S
dc.contributor.author	Zhang, X
dc.contributor.author	Khadra, S
dc.contributor.author	Tracy, M
dc.contributor.author	Koria, L
dc.contributor.author	Lo, S
dc.contributor.author	Naganathan, V
dc.contributor.author	Kim, J
dc.contributor.author	Dunn, AG
dc.contributor.author	Ayre, J https://orcid.org/0000-0002-5279-5189
dc.date.accessioned	2024-12-02T01:17:36Z
dc.date.available	2024-11-11
dc.date.available	2024-12-02T01:17:36Z
dc.date.issued	2024-11-20
dc.identifier.citation	NPJ Digit Med, 2024, 7, (1), pp. 329
dc.identifier.issn	2398-6352
dc.identifier.issn	2398-6352
dc.identifier.uri	http://hdl.handle.net/10453/182225
dc.description.abstract	Patient-centred instructions on discharge can improve adherence and outcomes. Using GPT-3.5 to generate patient-centred discharge instructions, we evaluated responses for safety, accuracy and language simplification. When tested on 100 discharge summaries from MIMIC-IV, potentially harmful safety issues attributable to the AI tool were found in 18%, including 6% with hallucinations and 3% with new medications. AI tools can generate patient-centred discharge instructions, but careful implementation is needed to avoid harms.
dc.format	Electronic
dc.language	eng
dc.publisher	Springer Nature
dc.relation.ispartof	NPJ Digit Med
dc.relation.isbasedon	10.1038/s41746-024-01336-w
dc.rights	info:eu-repo/semantics/openAccess
dc.subject.classification	4203 Health services and systems
dc.title	The quality and safety of using generative AI to produce patient-centred discharge instructions.
dc.type	Journal Article
utslib.citation.volume	7
utslib.location.activity	England
pubs.organisational-group	University of Technology Sydney
pubs.organisational-group	University of Technology Sydney/Faculty of Health
utslib.copyright.status	open_access	*
dc.rights.license	This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (CC BY-NC-ND 4.0). To view a copy of this license, visit https://creativecommons.org/licenses/by-nc-nd/4.0/
dc.date.updated	2024-12-02T01:17:33Z
pubs.issue	1
pubs.publication-status	Published online
pubs.volume	7
utslib.citation.issue	1

Abstract:

Patient-centred instructions on discharge can improve adherence and outcomes. Using GPT-3.5 to generate patient-centred discharge instructions, we evaluated responses for safety, accuracy and language simplification. When tested on 100 discharge summaries from MIMIC-IV, potentially harmful safety issues attributable to the AI tool were found in 18%, including 6% with hallucinations and 3% with new medications. AI tools can generate patient-centred discharge instructions, but careful implementation is needed to avoid harms.

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/182225