Machine learning with electrocardiograms: A call for guidelines and best practices for 'stress testing' algorithms

This paper provides a brief description of how computer programs are used to automatically interpret electrocardiograms (ECGs), and also provides a discussion regarding new opportunities. The algorithms that are typically used today in hospitals are knowledge engineered where a computer programmer manually writes computer code and logical statements which are then used to deduce a possible diagnosis. The computer programmer's code represents the criteria and knowledge that is used by clinicians when reading ECGs. This is in contrast to supervised machine learning (ML) approaches which use large, labelled ECG datasets to induct their own ‘rules’ to automatically classify ECGs. Although there are many ML techniques, deep neural networks are being increasingly explored as ECG classification algorithms when trained on large ECG datasets. Whilst this paper presents some of the pros and cons of each of these approaches, perhaps there are opportunities to develop hybridised algorithms that combine both knowledge and data driven techniques. In this paper, it is pointed out that open ECG data can dramatically influence what international ECG ML researchers focus on and that, ideally, open datasets could align with real world clinical challenges. In addition, some of the pitfalls and opportunities for ML with ECGs are outlined. A potential opportunity for the ECG community is to provide guidelines to researchers to help guide ECG ML practices. For example, whilst general ML guidelines exist, there is perhaps a need to recommend approaches for ‘stress testing’ and evaluating ML algorithms for ECG analysis, e.g. testing the algorithm with noisy ECGs and ECGs acquired using common lead and electrode misplacements. This paper provides a primer on ECG ML and discusses some of the key challenges and opportunities.