4.5 Article

SHA-MTL: soft and hard attention multi-task learning for automated breast cancer ultrasound image segmentation and classification

Journal

Publisher

SPRINGER HEIDELBERG
DOI: 10.1007/s11548-021-02445-7

Keywords

Breast ultrasound; Attention mechanism; Multi-task learning; Convolutional neural network

Funding

  1. Natural Science Foundation of China [61872225]
  2. Introduction and Cultivation Program for Young Creative Talents in Colleges and Universities of Shandong Province [173]
  3. Natural Science Foundation of Shandong Province [ZR2019ZD04, ZR2015FM010]
  4. Project of Science and technology plan of Shandong higher education institutions Program [J15LN20]
  5. Project of Shandong Province Medical and Health Technology Development Program [2016WS0577]

Ask authors/readers for more resources

The SHA-MTL model proposed in this study effectively performs simultaneous segmentation and binary classification of breast ultrasound (BUS) images. Through experiments and analyses, it is shown to achieve better results compared to recent models, emphasizing the importance of focusing on lesion regions for accurate classification.
Purpose The automatic analysis of ultrasound images facilitates the diagnosis of breast cancer effectively and objectively. However, due to the characteristics of ultrasound images, it is still a challenging task to achieve analyzation automatically. We suppose that the algorithm will extract lesion regions and distinguish categories easily if it is guided to focus on the lesion regions.Method We propose a multi-task learning (SHA-MTL) model based on soft and hard attention mechanisms for breast ultrasound (BUS) image simultaneous segmentation and binary classification. The SHA-MTL model consists of a dense CNN encoder and an upsampling decoder, which are connected by attention-gated (AG) units with soft attention mechanism. Cross-validation experiments are performed on BUS datasets with category and mask labels, and multiple comprehensive analyses are performed on the two tasks.Results We assess the SHA-MTL model on a public BUS image dataset. For the segmentation task, the sensitivity and DICE of the SHA-MTL model to the lesion regions increased by 2.27% and 1.19% compared with the single task model, respectively. The classification accuracy and F1 score increased by 2.45% and 3.82%, respectively.Conclusion The results validate the effectiveness of our model and indicate that the SHA-MTL model requires less a priori knowledge to achieve better results by comparing with other recent models. Therefore, we can draw the conclusion that paying more attention to the lesion region of BUS is conducive to the discrimination of lesion types.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Interdisciplinary Applications

Automated Pathogenesis-Based Diagnosis of Lumbar Neural Foraminal Stenosis via Deep Multiscale Multitask Learning

Zhongyi Han, Benzheng Wei, Stephanie Leung, Ilanit Ben Nachum, David Laidley, Shuo Li

NEUROINFORMATICS (2018)

Article Biology

Direct estimation of left ventricular ejection fraction via a cardiac cycle feature learning architecture

Tianyang Li, Benzheng Wei, Jinyu Cong, Yanfei Hong, Shuo Li

COMPUTERS IN BIOLOGY AND MEDICINE (2020)

Article Computer Science, Artificial Intelligence

MMCL-Net: Spinal disease diagnosis in global mode using progressive multi-task joint learning

Yanfei Hong, Benzheng Wei, Zhongyi Han, Xiang Li, Yuanjie Zheng, Shuo Li

NEUROCOMPUTING (2020)

Article Computer Science, Interdisciplinary Applications

Accurate Screening of COVID-19 Using Attention-Based Deep 3D Multiple Instance Learning

Zhongyi Han, Benzheng Wei, Yanfei Hong, Tianyang Li, Jinyu Cong, Xue Zhu, Haifeng Wei, Wei Zhang

IEEE TRANSACTIONS ON MEDICAL IMAGING (2020)

Article Computer Science, Artificial Intelligence

Unifying neural learning and symbolic reasoning for spinal medical report generation

Zhongyi Han, Benzheng Wei, Xiaoming Xi, Bo Chen, Yilong Yin, Shuo Li

Summary: The paper introduces a neural-symbolic learning framework that combines deep neural learning and symbolic logical reasoning to achieve human-like learning processes for spine medical report generation.

MEDICAL IMAGE ANALYSIS (2021)

Article Medical Informatics

A deep semantic segmentation correction network for multi-model tiny lesion areas detection

Yue Liu, Xiang Li, Tianyang Li, Bin Li, Zhensong Wang, Jie Gan, Benzheng Wei

Summary: This study proposed a novel segmentation correction algorithm to estimate lesion areas, achieving precise segmentation and recognition of small lesions such as FCI and LACI. The method showed potential clinical application and future directions include collecting more clinical data and testing more types of tiny lesions simultaneously.

BMC MEDICAL INFORMATICS AND DECISION MAKING (2021)

Article Computer Science, Information Systems

Weakly supervised semantic segmentation for skin cancer via CNN superpixel region response

Yanfei Hong, Guisheng Zhang, Benzheng Wei, Jinyu Cong, Yunfeng Xu, Kuixing Zhang

Summary: This study proposes a weakly supervised semantic segmentation algorithm for precise segmentation of skin cancer lesions at different stages, achieving effective discrimination and accurate segmentation of the lesion regions through the combination of convolutional neural network and superpixel algorithm.

MULTIMEDIA TOOLS AND APPLICATIONS (2023)

Article Biotechnology & Applied Microbiology

Automated Screening of COVID-19-Based Tongue Image on Chinese Medicine

Guang Zhang, Xueying He, Delin Li, Cuihuan Tian, Benzheng Wei

Summary: This study demonstrates the effectiveness of tongue image in screening COVID-19 and proposes a multimodal screening method based on tongue image, chest CT, or X-ray images, which can improve the screening accuracy. This provides a new perspective and solution for controlling the pandemic.

BIOMED RESEARCH INTERNATIONAL (2022)

Article Computer Science, Artificial Intelligence

Semi-Cycled Generative Adversarial Networks for Real-World Face Super-Resolution

Hao Hou, Jun Xu, Yingkun Hou, Xiaotao Hu, Benzheng Wei, Dinggang Shen

Summary: This paper proposes a Semi-Cycled Generative Adversarial Network (SCGAN) for real-world face super-resolution (SR). By establishing two independent degradation branches and sharing the same restoration branch, SCGAN is able to effectively utilize the generative capability of GAN for accurate and robust face SR. Experimental results demonstrate that SCGAN outperforms state-of-the-art methods in recovering face structures/details and quantitative metrics for real-world face SR.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2023)

Article Biochemistry & Molecular Biology

Identification Mechanism of BACE1 on Inhibitors Probed by Using Multiple Separate Molecular Dynamics Simulations and Comparative Calculations of Binding Free Energies

Yiwen Wang, Fen Yang, Dongliang Yan, Yalin Zeng, Benzheng Wei, Jianzhong Chen, Weikai He

Summary: In this study, the mechanism of BACE1 identification for three inhibitors was comparatively determined using molecular dynamics simulations and binding free energy calculations. The presence of the inhibitors affects the structural stability, flexibility, and internal dynamics of BACE1. The binding free energy calculations reveal that hydrophobic interactions play a decisive role in the binding between the inhibitors and BACE1. Residue-based free energy decomposition analysis suggests that specific residues contribute significantly to the inhibitor-BACE1 binding, providing insights for future drug design for AD treatment.

MOLECULES (2023)

Article Biochemistry & Molecular Biology

Binding Mechanism of Inhibitors to Heat Shock Protein 90 Investigated by Multiple Independent Molecular Dynamics Simulations and Prediction of Binding Free Energy

Fen Yang, Yiwen Wang, Dongliang Yan, Zhongtao Liu, Benzheng Wei, Jianzhong Chen, Weikai He

Summary: This study explores the binding mechanism of three inhibitors (W8Y, W8V, and W8S) to HSP90 through molecular dynamics simulations and MM-GBSA calculations. The presence of inhibitors impacts the structural flexibility, correlated movements, and dynamics behavior of HSP90. The MM-GBSA calculations reveal that van der Waals interactions are the main forces that determine inhibitor-HSP90 binding, while hydrogen-bonding interactions and hydrophobic interactions play important roles in HSP90-inhibitor identifications. Certain residues are recognized as hot spots of inhibitor-HSP90 binding, providing significant target sites for drug design related to HSP90.

MOLECULES (2023)

Article Computer Science, Information Systems

S3egANet: 3D Spinal Structures Segmentation via Adversarial Nets

Tianyang Li, Benzheng Wei, Jinyu Cong, Xuzhou Li, Shuo Li

IEEE ACCESS (2020)

Proceedings Paper Computer Science, Artificial Intelligence

Deep Learning Model Based Breast Cancer Histopathological Image Classification

Benzheng Wei, Zhongyi Han, Xueying He, Yilong Yin

2017 2ND IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYSIS (ICCCBDA 2017) (2017)

Article Biotechnology & Applied Microbiology

Automated Screening of COVID-19-Based Tongue Image on Chinese Medicine

Guang Zhang, Xueying He, Delin Li, Cuihuan Tian, Benzheng Wei

Summary: Artificial intelligence-powered screening systems for COVID-19 are in urgent demand due to the global outbreak. This study demonstrates the effectiveness of using tongue image in improving the screening accuracy of COVID-19 based on chest CT or X-ray images. The results show significant improvement in classification accuracy and provide a novel solution for large-scale screening.

BIOMED RESEARCH INTERNATIONAL (2022)

No Data Available