Interethnic Validation of an ECG Image Analysis Software for Detecting Left Ventricular Dysfunction in Emergency Department Population

Abstract

Background We previously developed and validated an AI-based ECG analysis tool (ECG Buddy) in a Korean population. This study aims to validate its performance in a U.S. population, specifically assessing its LV Dysfunction Score and LVEF-ECG feature for predicting LVEF <40%, using NT-ProBNP as a comparator.

Methods We identified emergency department (ED) visits from the MIMIC-IV dataset with information on LVEF <40% or ≥40%, along with matched 12-lead ECG data recorded within 48 hours of the ED visit. The performance of ECG Buddy’s LV Dysfunction Score and LVEF-ECG feature was compared with NT-ProBNP using Receiver Operating Characteristic - Area Under the Curve (ROC-AUC) analysis.

Results A total of 22,599 ED visits were analyzed. The LV Dysfunction Score had an AUC of 0.905 (95% CI: 0.899 - 0.910), with a sensitivity of 85.4% and specificity of 80.8%. The LVEF-ECG feature had an AUC of 0.908 (95% CI: 0.902 - 0.913), sensitivity 83.5%, and specificity 83.0%. NT-ProBNP had an AUC of 0.740 (95% CI: 0.727 - 0.752), with a sensitivity of 74.8% and specificity of 62.0%. The ECG-based predictors demonstrated superior diagnostic performance compared to NT-ProBNP (all p<0.001).

In the Sinus Rhythm subgroup, the LV Dysfunction Score achieved an AUC of 0.913, and LVEF-ECG had an AUC of 0.917, both outperforming NT-ProBNP (0.748, 95% CI: 0.732 - 0.763, all p<0.001).

Conclusion ECG Buddy demonstrated superior accuracy compared to NT-ProBNP in predicting LV systolic dysfunction, validating its utility in a U.S. ED population.

Competing Interest Statement

Joonghee Kim, MD, PhD developed the algorithm. He also founded a start-up company, ARPI Inc., where he serves as the CEO. Youngjin Cho, MD, PhD works for the company as a research director. Otherwise, there is no conflict of interest for the other authors.

Funding Statement

This research was supported by a grant of the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea (grant number : RS-2023-00265933), and the SNUBH Research Fund (grant number: 14-2023-0335).

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

Johnson, A., Bulgarelli, L., Pollard, T., Horng, S., Celi, L. A., & Mark, R. (2023). MIMIC-IV (version 2.2). PhysioNet. https://doi.org/10.13026/6mm1-ek67.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Comments (0)

No login
gif