Transformer Models in Healthcare: A Survey and Thematic Analysis of Potentials, Shortcomings and Risks

A. Vaswani et al, ‘Attention is All you Need’, in Advances in Neural Information Processing Systems, Curran Associates, Inc., 2017. Accessed: Jun. 18, 2023. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2017/hash/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html

Q. Wang et al, ‘Learning Deep Transformer Models for Machine Translation’, 2019, doi: https://doi.org/10.48550/ARXIV.1906.01787.

W. Wang, Z. Yang, Y. Gao, and H. Ney, ‘Transformer-Based Direct Hidden Markov Model for Machine Translation’, in Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: Student Research Workshop, Online: Association for Computational Linguistics, 2021, pp. 23–32. doi: https://doi.org/10.18653/v1/2021.acl-srw.3.

G. Moro, L. Ragazzi, L. Valgimigli, G. Frisoni, C. Sartori, and G. Marfia, ‘Efficient Memory-Enhanced Transformer for Long-Document Summarization in Low-Resource Regimes’, Sensors, vol. 23, no. 7, p. 3542, Mar. 2023, doi: https://doi.org/10.3390/s23073542.

X. Dai, I. Chalkidis, S. Darkner, and D. Elliott, ‘Revisiting Transformer-based Models for Long Document Classification’. arXiv, Oct. 25, 2022. Accessed: Feb. 03, 2024. [Online]. Available: http://arxiv.org/abs/2204.06683

A. Gillioz, J. Casas, E. Mugellini, and O. A. Khaled, ‘Overview of the Transformer-based Models for NLP Tasks’, presented at the 2020 Federated Conference on Computer Science and Information Systems, Sep. 2020, pp. 179–183. doi: https://doi.org/10.15439/2020F20.

X. Yang et al, ‘GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Records’, 2022, doi: https://doi.org/10.48550/ARXIV.2203.03540.

Article  Google Scholar 

K. Denecke, R. May, and O. Rivera Romero, ‘How Can Transformer Models Shape Future Healthcare: A Qualitative Study’, in Studies in Health Technology and Informatics, M. Giacomini, L. Stoicu-Tivadar, G. Balestra, A. Benis, S. Bonacina, A. Bottrighi, T. M. Deserno, P. Gallos, L. Lhotska, S. Marceglia, A. C. Pazos Sierra, S. Rosati, and L. Sacchi, Eds., IOS Press, 2023. doi: https://doi.org/10.3233/SHTI230736.

B. Meskó, ‘The Impact of Multimodal Large Language Models on Health Care’s Future’, J. Med. Internet Res., vol. 25, p. e52865, Nov. 2023, doi: https://doi.org/10.2196/52865.

Article  PubMed  PubMed Central  Google Scholar 

Y. Li et al, ‘BEHRT: Transformer for Electronic Health Records’, Sci. Rep., vol. 10, no. 1, p. 7155, Apr. 2020, doi: https://doi.org/10.1038/s41598-020-62922-y.

Article  ADS  CAS  PubMed  PubMed Central  Google Scholar 

Y. Gao, T. Miller, D. Xu, D. Dligach, M. M. Churpek, and M. Afshar, ‘Summarizing Patients’ Problems from Hospital Progress Notes Using Pre-trained Sequence-to-Sequence Models’, Proc. COLING Int. Conf. Comput. Linguist, vol. 2022, pp. 2979–2991, Oct. 2022.

I. Coutinho and B. Martins, ‘Transformer-based models for ICD-10 coding of death certificates with Portuguese text’, J. Biomed. Inform., vol. 136, p. 104232, Dec. 2022, doi: https://doi.org/10.1016/j.jbi.2022.104232.

Article  PubMed  Google Scholar 

J. Clusmann et al, ‘The future landscape of large language models in medicine’, Commun. Med., vol. 3, no. 1, p. 141, Oct. 2023, doi: https://doi.org/10.1038/s43856-023-00370-1.

Article  PubMed  PubMed Central  Google Scholar 

M. Cascella, J. Montomoli, V. Bellini, and E. Bignami, ‘Evaluating the Feasibility of ChatGPT in Healthcare: An Analysis of Multiple Clinical and Research Scenarios’, J. Med. Syst., vol. 47, no. 1, p. 33, Mar. 2023, doi: https://doi.org/10.1007/s10916-023-01925-4.

Article  PubMed  PubMed Central  Google Scholar 

X. Wang et al, ‘ChatGPT: promise and challenges for deployment in low- and middle-income countries’, Lancet Reg. Health - West. Pac., vol. 41, p. 100905, Dec. 2023, doi: https://doi.org/10.1016/j.lanwpc.2023.100905.

Article  PubMed  PubMed Central  Google Scholar 

V. Braun and V. Clarke, ‘Using thematic analysis in psychology’, Qual. Res. Psychol, vol. 3, no. 2, pp. 77–101, Jan. 2006, doi: https://doi.org/10.1191/1478088706qp063oa.

G. Eysenbach, ‘Improving the Quality of Web Surveys: The Checklist for Reporting Results of Internet E-Surveys (CHERRIES)’, J. Med. Internet Res., vol. 6, no. 3, p. e34, Sep. 2004, doi: https://doi.org/10.2196/jmir.6.3.e34.

Article  PubMed  PubMed Central  Google Scholar 

A. Tong, P. Sainsbury, and J. Craig, ‘Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups’, Int. J. Qual. Health Care, vol. 19, no. 6, pp. 349–357, Sep. 2007, doi: https://doi.org/10.1093/intqhc/mzm042.

J. Y. Luh, R. F. Thompson, and S. Lin, ‘Clinical Documentation and Patient Care Using Artificial Intelligence in Radiation Oncology’, J. Am. Coll. Radiol, vol. 16, no. 9, pp. 1343–1346, Sep. 2019, doi: https://doi.org/10.1016/j.jacr.2019.05.044.

F. Eggmann, R. Weiger, N. U. Zitzmann, and M. B. Blatz, ‘Implications of large language models such as ChatGPT for dental medicine’, J. Esthet. Restor. Dent, vol. 35, no. 7, pp. 1098–1102, Oct. 2023, doi: https://doi.org/10.1111/jerd.13046.

A. J. Thirunavukarasu, D. S. J. Ting, K. Elangovan, L. Gutierrez, T. F. Tan, and D. S. W. Ting, ‘Large language models in medicine’, Nat. Med, vol. 29, no. 8, pp. 1930–1940, Aug. 2023, doi: https://doi.org/10.1038/s41591-023-02448-8.

L. De Angelis et al, ‘ChatGPT and the rise of large language models: the new AI-driven infodemic threat in public health’, Front. Public Health, vol. 11, p. 1166120, Apr. 2023, doi: https://doi.org/10.3389/fpubh.2023.1166120.

Article  PubMed  PubMed Central  Google Scholar 

S. Reddy, ‘Evaluating large language models for use in healthcare: A framework for translational value assessment’, Inform. Med. Unlocked, vol. 41, p. 101304, 2023, doi: https://doi.org/10.1016/j.imu.2023.101304.

Article  Google Scholar 

S. Reddy et al, ‘Evaluation framework to guide implementation of AI systems into healthcare settings’, BMJ Health Care Inform, vol. 28, no. 1, p. e100444, Oct. 2021, doi: https://doi.org/10.1136/bmjhci-2021-100444.

M. Ahmad, I. Yaramic, and T. D. Roy, ‘Creating Trustworthy LLMs: Dealing with Hallucinations in Healthcare AI’, Computer Science and Mathematics, preprint, Oct. 2023. doi: https://doi.org/10.20944/preprints202310.1662.v1.

B. Meskó and E. J. Topol, ‘The imperative for regulatory oversight of large language models (or generative AI) in healthcare’, Npj Digit. Med., vol. 6, no. 1, p. 120, Jul. 2023, doi: https://doi.org/10.1038/s41746-023-00873-0.

Article  PubMed  PubMed Central  Google Scholar 

K. Denecke, R. May, E. Gabarron, and G. H. Lopez-Campos, ‘Assessing the Potential Risks of Digital Therapeutics (DTX): The DTX Risk Assessment Canvas’, J. Pers. Med., vol. 13, no. 10, p. 1523, Oct. 2023, doi: https://doi.org/10.3390/jpm13101523.

Article  PubMed  PubMed Central  Google Scholar 

C. Hardebolle, V. Macko, V. Ramachandran, A. Holzer, and P. Jermann, ‘Digital Ethics Canvas: A Guide For Ethical Risk Assessment And Mitigation In The Digital Domain’, 2023, doi: https://doi.org/10.21427/9WA5-ZY95.

S. Harrer, ‘Attention is not all you need: the complicated case of ethically using large language models in healthcare and medicine’, eBioMedicine, vol. 90, p. 104512, Apr. 2023, doi: https://doi.org/10.1016/j.ebiom.2023.104512.

M. Mittermaier, M. M. Raza, and J. C. Kvedar, ‘Bias in AI-based models for medical applications: challenges and mitigation strategies’, NPJ Digit. Med., vol. 6, no. 1, p. 113, Jun. 2023, doi: https://doi.org/10.1038/s41746-023-00858-z.

Article  PubMed  PubMed Central  Google Scholar 

Z. Guo et al, ‘Evaluating Large Language Models: A Comprehensive Survey’, 2023, doi: https://doi.org/10.48550/ARXIV.2310.19736.

A. Palmer and D. Schwan, ‘Beneficent dehumanization: Employing artificial intelligence and carebots to mitigate shame-induced barriers to medical care’, Bioethics, vol. 36, no. 2, pp. 187–193, Feb. 2022, doi: https://doi.org/10.1111/bioe.12986.

K. V. Garvey, K. J. Thomas Craig, R. Russell, L. L. Novak, D. Moore, and B. M. Miller, ‘Considering Clinician Competencies for the Implementation of Artificial Intelligence–Based Tools in Health Care: Findings From a Scoping Review’, JMIR Med. Inform, vol. 10, no. 11, p. e37478, Nov. 2022, doi: https://doi.org/10.2196/37478.

P. Esmaeilzadeh, ‘Use of AI-based tools for healthcare purposes: a survey study from consumers’ perspectives’, BMC Med. Inform. Decis. Mak., vol. 20, no. 1, p. 170, Dec. 2020, doi: https://doi.org/10.1186/s12911-020-01191-1.

Article  PubMed  PubMed Central  Google Scholar 

留言 (0)

沒有登入
gif