期刊
NEURAL COMPUTING & APPLICATIONS
卷 33, 期 11, 页码 5793-5804出版社
SPRINGER LONDON LTD
DOI: 10.1007/s00521-020-05358-9
关键词
Multi-focus image fusion; Unsupervised deep learning; Spatial frequency
资金
- National Key Research and Development Program of China [2016YFB0700500]
- National Science Foundation of China [6170203, 61873299]
- Key Research Plan of Hainan Province [ZDYF2019009]
- Guangdong Province Key Area R and D Program [2019B010940001]
- Scientific and Technological Innovation Foundation of Shunde Graduate School, USTB [BK19BE030]
- Fundamental Research Funds for the University of Science and Technology Beijing [FRF-BD-19-012A, FRF-TP-19-043A2]
- USTB MatCom of Beijing Advanced Innovation Center for Materials Genome Engineering
The study introduces an unsupervised deep learning model for multi-focus image fusion, achieving state-of-the-art fusion performance in objective and subjective assessments, especially in gradient-based fusion metrics.
Muti-focus image fusion is the extraction of focused regions from different images to create one all-in-focus fused image. The key point is that only objects within the depth-of-field have a sharp appearance in the photograph, while other objects are likely to be blurred. We propose an unsupervised deep learning model for multi-focus image fusion. We train an encoder-decoder network in an unsupervised manner to acquire deep features of input images. Then, we utilize spatial frequency, a gradient-based method to measure sharp variation from these deep features, to reflect activity levels. We apply some consistency verification methods to adjust the decision map and draw out the fused result. Our method analyzes sharp appearances in deep features instead of original images, which can be seen as another success story of unsupervised learning in image processing. Experimental results demonstrate that the proposed method achieves state-of-the-art fusion performance compared to 16 fusion methods in objective and subjective assessments, especially in gradient-based fusion metrics.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据