4.5 Article

Multimodal biomedical image fusion method via rolling guidance filter and deep convolutional neural networks

Journal

OPTIK
Volume 237, Issue -, Pages -

Publisher

ELSEVIER GMBH
DOI: 10.1016/j.ijleo.2021.166726

Keywords

Image fusion; Biomedical; Rolling guidance filter; Convolutional neural network

Categories

Funding

  1. National Key Research and Development Program of China [2016YFC1000307-3, 2019YFE0110800]
  2. National Natural Science Foundation of China [61972060, U1713213, 62027827]
  3. Doctoral Talent Training Project of Chongqing University of Posts and Telecommunications [BYJS202002]
  4. Natural Science Foundation of Chongqing [cstc2020jcyj-zdxmX0025, cstc2019cxcyljrc-td0270, cstc2019jcyj-cxttX0002]

Ask authors/readers for more resources

A multimodal biomedical image fusion method is proposed in this paper using rolling guidance filter and deep convolutional neural network, which involves extracting base and detail images using the rolling guidance filter, enhancing fusion quality by extracting perceptual images using the VGG network, and fusing base, detail, and perceptual images using three different fusion strategies. The proposed algorithm demonstrates better fusion results and objective metrics compared to reference fusion methods in extensive experiments.
Recently, numerous image fusion algorithms have been proposed and widely used in the biomedical field. However, most existing algorithms have low luminance, blurry edges and unclear details. To overcome these weaknesses, a multimodal biomedical image fusion method via rolling guidance filter and deep convolutional neural network is proposed in this paper. To enhance image edges and details, the VGG network is utilized. Our fusion algorithm includes three steps. First, the rolling guidance filter is utilized to extract the base and detail images. Second, the perceptual images are extracted by the VGG network to improve the fusion quality. Finally, the base, detail and perceptual images are fused by three different fusion strategies. Specially, the image decomposition parameters are selected based on experiments in order to extract appropriate texture and structure images. Additionally, the normalization operation is applied to the perceptual images that extracted by the VGG network for removing the feature differences and noise. Extensive experiments demonstrate that our proposed algorithm has better fusion results and objective metrics than the reference fusion methods.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Engineering, Biomedical

A multiscale residual pyramid attention network for medical image fusion

Jun Fu, Weisheng Li, Jiao Du, Yuping Huang

Summary: In this study, a multiscale residual pyramid attention network (MSRPAN) for medical image fusion is proposed, which achieves better fusion results through feature extraction, reconstruction, and a feature fusion strategy. Compared to existing algorithms, the proposed MSRPAN network demonstrates superior performance in terms of both visual quality and objective metrics.

BIOMEDICAL SIGNAL PROCESSING AND CONTROL (2021)

Article Computer Science, Interdisciplinary Applications

CDRNet: Cascaded dense residual network for grayscale and pseudocolor medical image fusion

Jun Fu, Baiqing He, Jie Yang, Jianpeng Liu, Aijia Ouyang, Ya Wang

Summary: In this paper, a cascaded dense residual network is proposed and used for grayscale and pseudocolor medical image fusion. Through the cascaded dense residual network, the fusion results have better performance in terms of edge strength, richer details, and objective indicators than the reference algorithms.

COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE (2023)

No Data Available