Evaluating the Feasibility of ChatGPT in Healthcare: An Analysis of Multiple Clinical and Research Scenarios

被引:584
作者
Cascella, Marco [1 ]
Montomoli, Jonathan [2 ]
Bellini, Valentina [3 ]
Bignami, Elena [3 ]
机构
[1] Fdn Pascale, Ist Nazl Tumori, Dept Anesthesia & Crit Care, IRCCS, Via Mariano Semmola, 53, I-80131 Naples, Italy
[2] AUSL Romagna, Infermi Hosp, Dept Anesthesia & Intens Care, Viale Settembrini 2, I-47923 Rimini, Italy
[3] Univ Parma, Dept Med & Surg, Anesthesiol Crit Care & Pain Med Div, Viale Gramsci 14, I-43126 Parma, Italy
关键词
Artificial intelligence; ChatGPT; Medicine; Clinical resaerch; TRIAL;
D O I
10.1007/s10916-023-01925-4
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
This paper aims to highlight the potential applications and limits of a large language model (LLM) in healthcare. ChatGPT is a recently developed LLM that was trained on a massive dataset of text for dialogue with users. Although AI-based language models like ChatGPT have demonstrated impressive capabilities, it is uncertain how well they will perform in real-world scenarios, particularly in fields such as medicine where high-level and complex thinking is necessary. Furthermore, while the use of ChatGPT in writing scientific articles and other scientific outputs may have potential benefits, important ethical concerns must also be addressed. Consequently, we investigated the feasibility of ChatGPT in clinical and research scenarios: (1) support of the clinical practice, (2) scientific production, (3) misuse in medicine and research, and (4) reasoning about public health topics. Results indicated that it is important to recognize and promote education on the appropriate use and potential pitfalls of AI-based LLMs in medicine.
引用
收藏
页数:5
相关论文
共 14 条
[1]   Haloperidol for the Treatment of Delirium in ICU Patients [J].
Andersen-Ranberg, Nina C. ;
Poulsen, Lone M. ;
Perner, Anders ;
Wetterslev, Jorn ;
Estrup, Stine ;
Haestbacka, Johanna ;
Morgan, Matt ;
Citerio, Giuseppe ;
Caballero, Jesus ;
Lange, Theis ;
Kjaer, Maj-Brit N. ;
Ebdrup, Bjorn H. ;
Engstrom, Janus ;
Olsen, Markus H. ;
Oxenboll Collet, Marie ;
Mortensen, Camilla B. ;
Weber, Sven-Olaf ;
Andreasen, A. Sofie ;
Bestle, Morten H. ;
Uslu, Buelent ;
Scharling Pedersen, Helle ;
Gramstrup Nielsen, Louise ;
Toft Boesen, Hans C. ;
Jensen, Jacob V. ;
Nebrich, Lars ;
La Cour, Kirstine ;
Laigaard, Jens ;
Haurum, Cecilie ;
Olesen, Marie W. ;
Overgaard-Steensen, Christian ;
Westergaard, Bo ;
Brand, Bjorn A. ;
Kingo Vesterlund, Gitte ;
Thornberg Kyhnauv, Pernille ;
Mikkelsen, Vibe S. ;
Hyttel-Sorensen, Simon ;
de Haas, Inge ;
Aagaard, Soren R. ;
Nielsen, Line O. ;
Eriksen, Anne S. ;
Rasmussen, Bodil S. ;
Brix, Helene ;
Hildebrandt, Thomas ;
Schonemann-Lund, Martin ;
Fjeldsoe-Nielsen, Hans ;
Kuivalainen, Anna-Maria ;
Mathiesen, Ole ;
AID ICU Trial Grp .
NEW ENGLAND JOURNAL OF MEDICINE, 2022, 387 (26) :2425-2435
[2]   Defibrillation Strategies for Refractory Ventricular Fibrillation [J].
Cheskes, Sheldon ;
Verbeek, P. Richard ;
Drennan, Ian R. R. ;
McLeod, Shelley L. L. ;
Turner, Linda ;
Pinto, Ruxandra ;
Feldman, Michael ;
Davis, Matthew ;
Vaillancourt, Christian ;
Morrison, Laurie J. J. ;
Dorian, Paul ;
Scales, Damon C. C. .
NEW ENGLAND JOURNAL OF MEDICINE, 2022, 387 (21) :1947-1956
[3]   Trial of Deferiprone in Parkinson's Disease [J].
Devos, David ;
Labreuche, Julien ;
Rascol, Olivier ;
Corvol, Jean-Christophe ;
Duhamel, Alain ;
Delannoy, P. Guyon ;
Poewe, Werner ;
Compta, Yaroslau ;
Pavese, Nicola ;
Ruzicka, Evzen ;
Dusek, Petr ;
Post, Bart ;
Bloem, Bastiaan R. ;
Berg, Daniela ;
Maetzler, Walter ;
Otto, Markus ;
Habert, Marie-Odile ;
Lehericy, Stephane ;
Ferreira, Joaquim ;
Dodel, Richard ;
Tranchant, Christine ;
Eusebio, Alexandre ;
Thobois, Stephane ;
Marques, Ana-Raquel ;
Meissner, Wassilios G. ;
Ory-Magne, Fabienne ;
Walter, Uwe ;
de Bie, Rob M. A. ;
Gago, Miguel ;
Vilas, Dolores ;
Kulisevsky, Jaime ;
Januario, Cristina ;
Coelho, Miguel V. S. ;
Behnke, Stefanie ;
Worth, Paul ;
Seppi, Klaus ;
Ouk, Thavarak ;
Potey, Camille ;
Leclercq, Celine ;
Viard, Romain ;
Kuchcinski, Gregory ;
Lopes, Renaud ;
Pruvo, Jean-Pierre ;
Pigny, Pascal ;
Garcon, Guillaume ;
Simonin, Ophelie ;
Carpentier, Jessica ;
Rolland, Anne-Sophie ;
Nyholm, Dag ;
Scherfler, Christoph .
NEW ENGLAND JOURNAL OF MEDICINE, 2022, 387 (22) :2045-2055
[4]   ABSTRACTS WRITTEN BY CHATGPT FOOL SCIENTISTS [J].
Else, Holly .
NATURE, 2023, 613 (7944) :423-423
[5]   GPT-3: Its Nature, Scope, Limits, and Consequences [J].
Floridi, Luciano ;
Chiriatti, Massimo .
MINDS AND MACHINES, 2020, 30 (04) :681-694
[6]   Trial of Anti-BDCA2 Antibody Litifilimab for Systemic Lupus Erythematosus [J].
Furie, Richard A. ;
van Vollenhoven, Ronald F. ;
Kalunian, Kenneth ;
Navarra, Sandra ;
Romero-Diaz, Juanita ;
Werth, Victoria P. ;
Huang, Xiaobi ;
Clark, George ;
Carroll, Hua ;
Meyers, Adam ;
Musselli, Cristina ;
Barbey, Catherine ;
Franchimont, Nathalie .
NEW ENGLAND JOURNAL OF MEDICINE, 2022, 387 (10) :894-904
[7]   ChatGPT: evolution or revolution? [J].
Gordijn, Bert ;
ten Have, Henk .
MEDICINE HEALTH CARE AND PHILOSOPHY, 2023, 26 (01) :1-2
[8]   Prostate Cancer Screening with PSA and MRI Followed by Targeted Biopsy Only [J].
Hugosson, Jonas ;
Mansson, Marianne ;
Wallstrom, Jonas ;
Axcrona, Ulrika ;
Carlsson, Sigrid V. ;
Egevad, Lars ;
Geterud, Kjell ;
Khatami, Ali ;
Kohestani, Kimia ;
Pihl, Carl-Gustaf ;
Socratous, Andreas ;
Stranne, Johan ;
Godtman, Rebecka Arnsrud ;
Hellstrom, Mikael .
NEW ENGLAND JOURNAL OF MEDICINE, 2022, 387 (23) :2126-2137
[9]   COULD AI HELP YOU TO WRITE YOUR NEXT PAPER? [J].
Hutson, Matthew .
NATURE, 2022, 611 (7934) :192-193
[10]  
Kung HT, 2022, preprint. Medical Education, V12, DOI DOI 10.1101/2022.12