4.7 Review

Deep learning in spatiotemporal cardiac imaging: A review of methodologies and clinical usability

Journal

COMPUTERS IN BIOLOGY AND MEDICINE
Volume 130, Issue -, Pages -

Publisher

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.compbiomed.2020.104200

Keywords

Deep learning; Cardiovascular imaging; Spatiotemporal image data; Clinical usability

Ask authors/readers for more resources

The review explored the application of deep learning in dynamic cardiac imaging, revealing that the field is still heavily research-focused and faces challenges in transitioning to clinical practice. Challenges include addressing dataset quality and clinical validation of the methods' performance.
The use of different cardiac imaging modalities such as MRI, CT or ultrasound enables the visualization and interpretation of altered morphological structures and function of the heart. In recent years, there has been an increasing interest in AI and deep learning that take into account spatial and temporal information in medical image analysis. In particular, deep learning tools using temporal information in image processing have not yet found their way into daily clinical practice, despite its presumed high diagnostic and prognostic value. This review aims to synthesize the most relevant deep learning methods and discuss their clinical usability in dynamic cardiac imaging using for example the complete spatiotemporal image information of the heart cycle. Selected articles were categorized according to the following indicators: clinical applications, quality of datasets, preprocessing and annotation, learning methods and training strategy, and test performance. Clinical usability was evaluated based on these criteria by classifying the selected papers into (i) clinical level, (ii) robust candidate and (iii) proof of concept applications. Interestingly, not a single one of the reviewed papers was classified as a clinical level study. Almost 39% of the articles achieved a robust candidate and as many as 61% a proof of concept status. In summary, deep learning in spatiotemporal cardiac imaging is still strongly research-oriented and its implementation in clinical application still requires considerable efforts. Challenges that need to be addressed are the quality of datasets together with clinical verification and validation of the performance achieved by the used method.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Genetics & Heredity

Novel subtype of mucopolysaccharidosis caused by arylsulfatase K (ARSK) deficiency

Sarah Verheyen, Jasmin Blatterer, Michael R. Speicher, Gandham SriLakshmi Bhavani, Geert-Jan Boons, Mai-Britt Ilse, Dominik Andrae, Jens Spross, Frederic Maxime Vaz, Susanne G. Kircher, Laura Posch-Pertl, Daniela Baumgartner, Torben Luebke, Hitesh Shah, Ali Al Kaissi, Katta M. Girisha, Barbara Plecko

Summary: This study reports four affected individuals from two unrelated consanguineous families with MPS-related features, showing additional cardiac and ophthalmological abnormalities in some cases. The detection of mild elevation of a specific GAG in some subjects suggests a novel subtype of mucopolysaccharidosis, which is proposed to be named subtype X.

JOURNAL OF MEDICAL GENETICS (2022)

Article Cell Biology

Ion Channel Modeling beyond State of the Art: A Comparison with a System Theory-Based Model of the Shaker-Related Voltage-Gated Potassium Channel Kv1.1

Sonja Langthaler, Jasmina Lozanovic Sajic, Theresa Rienmueller, Seth H. Weinberg, Christian Baumgartner

Summary: The mathematical modeling of ion channel kinetics is crucial for understanding electrophysiological mechanisms. In this paper, a new system theory-based approach is introduced, using transfer function characterization and patch clamp measurements, which shows exceptional accuracy and computational efficiency compared to traditional methods. This method has the potential to improve cell and organ model simulations and is a valuable tool for next-generation electrophysiology.

CELLS (2022)

Article Engineering, Biomedical

A Human-Centered Machine-Learning Approach for Muscle-Tendon Junction Tracking in Ultrasound Images

Christoph Leitner, Robert Jarolim, Bernhard Englmair, Annika Kruse, Karen Andrea Lara Hernandez, Andreas Konrad, Eric Yung-Sheng Su, Joerg Schroettner, Luke A. Kelly, Glen A. Lichtwark, Markus Tilp, Christian Baumgartner

Summary: Biomechanical and clinical gait research use machine learning to track muscle-tendon junctions, providing support in gait analysis. Extensive data collection and deep learning training showed that the model achieved similar performance in identifying junction position compared to human experts, and it is 100 times faster than manual labeling.

IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING (2022)

Review Chemistry, Analytical

A Systematic Review of the Transthoracic Impedance during Cardiac Defibrillation

Yasmine Heyer, Daniela Baumgartner, Christian Baumgartner

Summary: Understanding the range and limits of human trans thoracic impedance (TTI) is crucial for cardiac defibrillator testing and design. A literature survey based on 71 selected articles revealed that TTI varied from 12 to 212 Ohms, with an average TTI of 76.7 Ohms. Factors such as shock waveforms and protocols, coupling devices, electrode characteristics, and patient characteristics were found to influence TTI, with coupling devices, electrode size, and pressure having the greatest impact.

SENSORS (2022)

Article Materials Science, Multidisciplinary

Light Stimulation of Neurons on Organic Photocapacitors Induces Action Potentials with Millisecond Precision

Tony Schmidt, Marie Jakesova, Vedran Derek, Karin Kornmueller, Oleksandra Tiapko, Helmut Bischof, Sandra Burgstaller, Linda Waldherr, Marta Nowakowska, Christian Baumgartner, Muammer Ucal, Gerd Leitinger, Susanne Scheruebel, Silke Patz, Roland Malli, Eric Daniel Glowacki, Theresa Rienmueller, Rainer Schindl

Summary: This research evaluates the performance of organic electrolytic photocapacitor (OEPC) optoelectronic stimulators on single mammalian cells and neurons, demonstrating the ability to manipulate channel conductivity and trigger action potentials with millisecond precision. This opens up possibilities for novel in vitro electrophysiology protocols and potential in vivo applications.

ADVANCED MATERIALS TECHNOLOGIES (2022)

Editorial Material Oncology

The world's first digital cell twin in cancer electrophysiology: a digital revolution in cancer research?

Christian Baumgartner

Summary: The introduction of functional in-silico models opens up new possibilities in cancer research and drug development. The digital twin of A549 cell's electrophysiology allows investigation of ion channel function and prediction of cell cycle progression changes. The model provides a platform for verifying research hypotheses and optimizing experimental methods.

JOURNAL OF EXPERIMENTAL & CLINICAL CANCER RESEARCH (2022)

Article Computer Science, Interdisciplinary Applications

Deep Learning-Based Image Registration in Dynamic Myocardial Perfusion CT Imaging

A. Lara-Hernandez, T. Rienmueller, I. Juarez, M. Perez, F. Reyna, D. Baumgartner, V. N. Makarenko, O. L. Bockeria, M. Maksudov, R. Rienmueller, C. Baumgartner

Summary: This article introduces a deep learning-based deformable image registration method for quantitative myocardial perfusion CT examinations in dynamic cardiac cycles. The method addresses unique challenges such as low image quality, inaccurate anatomical landmarks, dynamic changes in contrast agent concentration, and misalignment caused by cardiac stress, respiration, and patient motion. The proposed method reduces local tissue displacements of the left ventricle and demonstrates fast processing time compared to conventional methods, making it suitable for daily clinical routine.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2023)

Article Physiology

A system theory based digital model for predicting the cumulative fluid balance course in intensive care patients

Mathias Polz, Katharina Bergmoser, Martin Horn, Michael Schoerghuber, Jasmina Lozanovic, Theresa Rienmueller, Christian Baumgartner

Summary: This study presents a novel digital model for predicting cumulative fluid balance (CFB) based on system theory. The model utilizes recorded patient fluid data as the sole parameter source and applies the concept of a transfer function. The results demonstrate that a combination of 48-hour estimation time and 8-16-hour prediction time achieves high accuracy in CFB prediction. This study provides a promising proof of principle for developing computational models for fluid prediction that do not require large datasets.

FRONTIERS IN PHYSIOLOGY (2023)

Article Materials Science, Multidisciplinary

Fully Printed Flexible Ultrasound Transducer for Medical Applications

Kirill Keller, Christoph Leitner, Christian Baumgartner, Luca Benini, Francesco Greco

Summary: We present the fabrication of a fully printed, lead-free, polymer piezoelectric transducer and demonstrate the characterization of its structural, dielectric, and ferroelectric properties at different processing stages. The performance of the transducer made with poly(vinylidene fluoride-trifluoroethylene) is evaluated through resonance frequency analyses, acoustic power measurements, and pulse-echo experiments. Importantly, we demonstrate an optimal performance in the medical ultrasound range (<15 MHz) with acoustic power >1 W cm(-2) for the first time in a fully printed transducer, which shows promise for applications in epidermal and wearable electronics. Overall, these findings lay a strong foundation for future research in the field of flexible ultrasound transducers.

ADVANCED MATERIALS TECHNOLOGIES (2023)

Editorial Material Oncology

A regulatory challenge for natural language processing (NLP)-based tools such as ChatGPT to be legally used for healthcare decisions. Where are we now?

Christian Baumgartner, Daniela Baumgartner

CLINICAL AND TRANSLATIONAL MEDICINE (2023)

Article Biology

Multimodal pre-screening can predict BCI performance variability: A novel subject-specific experimental scheme

Seyyed Bahram Borgheai, Alyssa Hillary Zisk, John McLinden, James Mcintyre, Reza Sadjadi, Yalda Shahriari

Summary: This study proposed a novel personalized scheme using fNIRS and EEG as the main tools to predict and compensate for the variability in BCI systems, especially for individuals with severe motor deficits. By establishing predictive models, it was found that there were significant associations between the predicted performances and the actual performances.

COMPUTERS IN BIOLOGY AND MEDICINE (2024)

Article Biology

Exploring a novel HE image segmentation technique for glioblastoma: A hybrid slime mould and differential evolution approach

Hongliang Guo, Hanbo Liu, Ahong Zhu, Mingyang Li, Helong Yu, Yun Zhu, Xiaoxiao Chen, Yujia Xu, Lianxing Gao, Qiongying Zhang, Yangping Shentu

Summary: In this paper, a BDSMA-based image segmentation method is proposed, which improves the limitations of the original algorithm by combining SMA with DE and introducing a cooperative mixing model. The experimental results demonstrate the superiority of this method in terms of convergence speed and precision compared to other methods, and its successful application to brain tumor medical images.

COMPUTERS IN BIOLOGY AND MEDICINE (2024)

Article Biology

Semi-supervised point consistency network for retinal artery/vein classification

Jingfei Hu, Linwei Qiu, Hua Wang, Jicong Zhang

Summary: This study proposes a novel semi-supervised point consistency network (SPC-Net) for retinal artery/vein (A/V) classification, addressing the challenges of specific tubular structures and limited well-labeled data in CNN-based approaches. The SPC-Net combines an AVC module and an MPC module, and introduces point set representations and consistency regularization to improve the accuracy of A/V classification.

COMPUTERS IN BIOLOGY AND MEDICINE (2024)

Article Biology

ConTraNet: A hybrid network for improving the classification of EEG and EMG signals with limited training data

Omair Ali, Muhammad Saif-ur-Rehman, Tobias Glasmachers, Ioannis Iossifidis, Christian Klaes

Summary: This study introduces a novel hybrid model called ConTraNet, which combines the strengths of CNN and Transformer neural networks, and achieves significant improvement in classification performance with limited training data.

COMPUTERS IN BIOLOGY AND MEDICINE (2024)

Article Biology

A novel mobile phone and tablet application for automatized calculation of pain extent

Juan Antonio Valera-Calero, Dario Lopez-Zanoni, Sandra Sanchez-Jorge, Cesar Fernandez-de-las-Penas, Marcos Jose Navarro-Santana, Sofia Olivia Calvo-Moreno, Gustavo Plaza-Manzano

Summary: This study developed an easy-to-use application for assessing the diagnostic accuracy of digital pain drawings (PDs) compared to the classic paper-and-pencil method. The results demonstrated that digital PDs have higher reliability and accuracy compared to paper-and-pencil PDs, and there were no significant differences in assessing pain extent between the two methods. The PAIN EXTENT app showed good convergent validity.

COMPUTERS IN BIOLOGY AND MEDICINE (2024)

Article Biology

Radial magnetic resonance image reconstruction with a deep unrolled projected fast iterative soft-thresholding network

Biao Qu, Jialue Zhang, Taishan Kang, Jianzhong Lin, Meijin Lin, Huajun She, Qingxia Wu, Meiyun Wang, Gaofeng Zheng

Summary: This study proposes a deep unrolled neural network, pFISTA-DR, for radial MRI image reconstruction, which successfully preserves image details using a preprocessing module, learnable convolution filters, and adaptive threshold.

COMPUTERS IN BIOLOGY AND MEDICINE (2024)

Article Biology

Improving mixed-integer temporal modeling by generating synthetic data using conditional generative adversarial networks: A case study of fluid overload prediction in the intensive care unit

Alireza Rafiei, Milad Ghiasi Rad, Andrea Sikora, Rishikesan Kamaleswaran

Summary: This study aimed to improve machine learning model prediction of fluid overload by integrating synthetic data, which could be translated to other clinical outcomes.

COMPUTERS IN BIOLOGY AND MEDICINE (2024)

Article Biology

Densely connected convolutional networks for ultrasound image based lesion segmentation

Jinlian Ma, Dexing Kong, Fa Wu, Lingyun Bao, Jing Yuan, Yusheng Liu

Summary: In this study, a new method based on MDenseNet is proposed for automatic segmentation of nodular lesions from ultrasound images. Experimental results demonstrate that the proposed method can accurately extract multiple nodules from thyroid and breast ultrasound images, with good accuracy and reproducibility, and it shows great potential in other clinical segmentation tasks.

COMPUTERS IN BIOLOGY AND MEDICINE (2024)

Article Biology

Multi-omics fusion with soft labeling for enhanced prediction of distant metastasis in nasopharyngeal carcinoma patients after radiotherapy

Jiabao Sheng, SaiKit Lam, Jiang Zhang, Yuanpeng Zhang, Jing Cai

Summary: Omics fusion is an important preprocessing approach in medical image processing that assists in various studies. This study aims to develop a fusion methodology for predicting distant metastasis in nasopharyngeal carcinoma by mitigating the disparities in omics data and utilizing a label-softening technique and a multi-kernel-based neural network.

COMPUTERS IN BIOLOGY AND MEDICINE (2024)

Article Biology

Regularity and variability of functional brain connectivity characteristics between gyri and sulci under naturalistic stimulus

Zhenxiang Xiao, Liang He, Boyu Zhao, Mingxin Jiang, Wei Mao, Yuzhong Chen, Tuo Zhang, Xintao Hu, Tianming Liu, Xi Jiang

Summary: This study systematically investigates the functional connectivity characteristics between gyri and sulci in the human brain under naturalistic stimulus, and identifies unique features in these connections. This research provides novel insights into the functional brain mechanism under naturalistic stimulus and lays a solid foundation for accurately mapping the brain anatomy-function relationship.

COMPUTERS IN BIOLOGY AND MEDICINE (2024)

Article Biology

Unraveling the allosteric inhibition mechanism of PARP-1 CAT and the D766/770A mutation effects via Gaussian accelerated molecular dynamics and Markov state model

Qianqian Wang, Mingyu Zhang, Aohan Li, Xiaojun Yao, Yingqing Chen

Summary: The development of PARP-1 inhibitors is crucial for the treatment of various cancers. This study investigates the structural regulation of PARP-1 by different allosteric inhibitors, revealing the basis of allosteric inhibition and providing guidance for the discovery of more innovative PARP-1 inhibitors.

COMPUTERS IN BIOLOGY AND MEDICINE (2024)

Article Biology

DualAttNet: Synergistic fusion of image-level and fine-grained disease attention for multi-label lesion detection in chest X-rays

Qing Xu, Wenting Duan

Summary: In this paper, a dual attention supervised module, named DualAttNet, is proposed for multi-label lesion detection in chest radiographs. By efficiently fusing global and local lesion classification information, the module is able to recognize targets with different sizes. Experimental results show that DualAttNet outperforms baselines in terms of mAP and AP50 with different detection architectures.

COMPUTERS IN BIOLOGY AND MEDICINE (2024)

Article Biology

Searching for significant reactions and subprocesses in models of biological systems based on Petri nets

Kaja Gutowska, Piotr Formanowicz

Summary: The primary aim of this research is to propose algorithms for identifying significant reactions and subprocesses within biological system models constructed using classical Petri nets. These solutions enable two analysis methods: importance analysis for identifying critical individual reactions to the model's functionality and occurrence analysis for finding essential subprocesses. The utility of these methods has been demonstrated through analyses of an example model related to the DNA damage response mechanism. It should be noted that these proposed analyses can be applied to any biological phenomenon represented using the Petri net formalism. The presented analysis methods extend classical Petri net-based analyses, enhancing our comprehension of the investigated biological phenomena and aiding in the identification of potential molecular targets for drugs.

COMPUTERS IN BIOLOGY AND MEDICINE (2024)

Article Biology

LDP-GAN : Generative adversarial networks with local differential privacy for patient medical records synthesis

Hansle Gwon, Imjin Ahn, Yunha Kim, Hee Jun Kang, Hyeram Seo, Heejung Choi, Ha Na Cho, Minkyoung Kim, Jiye Han, Gaeun Kee, Seohyun Park, Kye Hwa Lee, Tae Joon Jun, Young-Hak Kim

Summary: Electronic medical records have potential in advancing healthcare technologies, but privacy issues hinder their full utilization. Deep learning-based generative models can mitigate this problem by creating synthetic data similar to real patient data. However, the risk of data leakage due to malicious attacks poses a challenge to traditional generative models. To address this, we propose a method that employs local differential privacy (LDP) to protect the model from attacks and preserve the privacy of training data, while generating medical data with reasonable performance.

COMPUTERS IN BIOLOGY AND MEDICINE (2024)

Article Biology

Phase retrieval for X-ray differential phase contrast radiography with knowledge transfer learning from virtual differential absorption model

Siwei Tao, Zonghan Tian, Ling Bai, Yueshu Xu, Cuifang Kuang, Xu Liu

Summary: This study proposes a transfer learning-based method to address the phase retrieval problem in grating-based X-ray phase contrast imaging. By generating a training dataset and using deep learning techniques, this method improves image quality and can be applied to X-ray 2D and 3D imaging.

COMPUTERS IN BIOLOGY AND MEDICINE (2024)