4.6 Article

Thermal infrared colorization via conditional generative adversarial network

期刊

INFRARED PHYSICS & TECHNOLOGY
卷 107, 期 -, 页码 -

出版社

ELSEVIER
DOI: 10.1016/j.infrared.2020.103338

关键词

Infrared images; Colorization; Deep learning; Convolutional neural networks

资金

  1. National Natural Science Foundation of China [11773018, 61727802]
  2. Key research & Development programs in Jiangsu China [BE2018126]
  3. Fundamental Research Funds for the Central Universities [30919011401, 30920010001]
  4. Leading Technology of Jiangsu Basic Research Plan [BK20192003]

向作者/读者索取更多资源

Transforming a thermal infrared image into a realistic RGB image is a challenging task. In this paper we propose a deep learning method to bridge this gap. We propose learning the transformation mapping using a coarse-to-fine generator that preserves the details. Since the standard mean squared loss cannot penalize the distance between colorized and ground truth images well, we propose a composite loss function that combines content, adversarial, perceptual and total variation losses. The content loss is used to recover global image information while the latter three losses are used to synthesize local realistic textures. Quantitative and qualitative experiments demonstrate that our approach significantly outperforms existing approaches on the KAIST multispectral pedestrian dataset, achieving more plausible RGB images. Our code is available online(2).( )

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Computer Science, Artificial Intelligence

Infrared target tracking based on proximal robust principal component analysis method

Chao Ma, Minjie Wan, Yunkai Xu, Kan Ren, Weixian Qian, Qian Chen, Guohua Gu

Summary: This paper proposes an infrared target tracker based on the proximal robust principal component analysis method, solves the convex optimization problem using the Alternating Direction Method of Multipliers, and locates the target using the particle filter framework.

APPLIED INTELLIGENCE (2022)

Article Computer Science, Artificial Intelligence

Infrared small target detection via region super resolution generative adversarial network

Kan Ren, Yuan Gao, Minjie Wan, Guohua Gu, Qian Chen

Summary: Infrared small target detection has always been a challenging problem due to the limited pixels and features of small infrared targets. Current optimization methods primarily focus on multi-scale feature fusion or super-resolution enhancement. However, when applying super-resolution networks to infrared target detection, two significant issues arise: excessive computational power consumption, resulting in low detection rates, and the disparity between low-resolution training images and the actual distribution of tiny targets, leading to poor detection accuracy. This paper proposes a new detection network, RSRGAN, which consists of a computationally efficient backbone network (RCN) for extracting potential regions and a GAN-based generator that includes modules for distribution transformation and super-resolution enhancement. The discriminator assists in generating better super-resolution images by distinguishing between generated and actual images. Additionally, the authors create an infrared UAV small target dataset, which includes birds, leaves, and other disturbances, to evaluate the algorithm's performance. Experimental results demonstrate that the proposed method achieves better detection of small IR targets and outperforms existing approaches.

APPLIED INTELLIGENCE (2022)

Article Computer Science, Artificial Intelligence

Object matching between visible and infrared images using a Siamese network

Wuxin Li, Qian Chen, Guohua Gu, Xiubao Sui

Summary: The study proposes a method for object matching between visible and infrared images using a Siamese neural network combined with a convolutional neural network for feature extraction and cross-correlation calculations for matched targets, achieving higher accuracy and precision in experiments.

APPLIED INTELLIGENCE (2022)

Article Geochemistry & Geophysics

Total Variation-Based Interframe Infrared Patch-Image Model for Small Target Detection

Minjie Wan, Guohua Gu, Yunkai Xu, Weixian Qian, Kan Ren, Qian Chen

Summary: This paper proposes a total variation-based interframe infrared patch-image model for infrared small target detection. By converting the infrared image into a patch-image consisting of a sparse target matrix and a low-rank background matrix, and introducing temporal consistency constraint and TV regularization term, the proposed model achieves better performance in infrared small target detection.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2022)

Article Geochemistry & Geophysics

Infrared Small Target Tracking via Gaussian Curvature-Based Compressive Convolution Feature Extraction

Minjie Wan, Xiaobo Ye, Xiaojie Zhang, Yunkai Xu, Guohua Gu, Qian Chen

Summary: The precision of infrared small target tracking is improved by a new method using compressive convolution feature extraction. This method utilizes a Gaussian curvature feature map and a three-layer compressive convolution network to represent each candidate target. Experiments show that the method achieves more satisfactory performances compared with other typical visual trackers.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2022)

Article Biochemical Research Methods

Accelerated Fourier ptychographic diffraction tomography with sparse annular LED illuminations

Shun Zhou, Jiaji Li, Jiasong Sun, Ning Zhou, Qian Chen, Chao Zuo

Summary: Fourier Ptychographic diffraction tomography (FPDT) is a label-free computational microscopy technique that retrieves high-resolution 3D tomograms by synthesizing low-resolution intensity images. Accelerated Fourier Ptychographic diffraction tomography (aFPDT) combines sparse annular LED illuminations and multiplexing to significantly reduce data and achieve computational acceleration. The method has been experimentally demonstrated on biological cells and has the potential to advance applications in biomedicine.

JOURNAL OF BIOPHOTONICS (2022)

Review Dentistry, Oral Surgery & Medicine

Optical Imaging in the Diagnosis of OPMDs Malignant Transformation

Y. Xu, X. Deng, Y. Sun, X. Wang, Y. Xiao, Y. Li, Q. Chen, L. Jiang

Summary: Oral potentially malignant disorders (OPMDs) are a group of oral lesions that have a variable risk of transforming into oral cancer. Traditional oral examinations may miss early malignant lesions, but optical techniques offer noninvasive methods for detecting these changes. This article provides a comprehensive review of various optical imaging methods used in the diagnosis of OPMDs, discussing their advantages, limitations, and future challenges.

JOURNAL OF DENTAL RESEARCH (2022)

Article Optics

Periodic integration-based polarization differential imaging for underwater image restoration

Jiajie Wang, Minjie Wan, Guohua Gu, Weixian Qian, Kan Ren, Qinyan Huang, Qian Chen

Summary: By proposing a new underwater image restoration method based on periodic integration of polarization images to replace orthogonal polarization images in traditional PDI systems, better performance in texture enhancement and noise suppression was achieved in underwater image restoration compared to existing PDI methods based on one or two pairs of orthogonal polarization images.

OPTICS AND LASERS IN ENGINEERING (2022)

Article Optics

Calibration and rectification of bi-telecentric lenses in Scheimpflug condition

Yan Hu, Zhongwei Liang, Shijie Feng, Wei Yin, Jiaming Qian, Qian Chen, Chao Zuo

Summary: The article introduces the Scheimpflug lens-based imaging model and its application, proposes a simplified imaging model based on projection, and develops calibration algorithms and rectification methods for stereo matching. The effectiveness and accuracy of the methods are verified through experiments.

OPTICS AND LASERS IN ENGINEERING (2022)

Review Optics

Depth estimation of multi-depth objects based on computational ghost imaging system

Wenwen Zhang, Daquan Yu, Yongcheng Han, Weiji He, Qian Chen, Ruiqing He

Summary: This paper introduces a computational ghost imaging technique to estimate the depth of an object by evaluating the degree of defocus in reconstructed images. It analyzes the images formed by multi-depth objects, selects the gradient domain as the image transformation space, and uses a compressed sensing algorithm based on TV norm to form the images. Additionally, it proposes a depth estimation strategy using variable resolution speckles to reduce the required depth slices.

OPTICS AND LASERS IN ENGINEERING (2022)

Article Optics

Photon-efficient 3D reconstruction employing a edge enhancement method

Xiaochen Zhao, Xiaoduo Jiang, Aojie Han, Tianyi Mao, Weiji He, Qian Chen

Summary: This paper explores how to improve the accuracy of edge reconstruction under sparse photon conditions and investigates the correlation between edge reconstruction accuracy and overall depth reconstruction accuracy.

OPTICS EXPRESS (2022)

Article Optics

Composite fringe projection deep learning profilometry for single-shot absolute 3D shape measurement

Yixuan Li, Jiaming Qian, Shijie Feng, Qian Chen, Chao Zuo

Summary: Single-shot fringe projection profilometry (FPP) is crucial for retrieving the absolute depth information of objects in high-speed dynamic scenes. This study proposes a composite fringe projection deep learning profilometry (CDLP) method that combines deep learning and physical model to achieve high-precision and unambiguous phase retrieval on a single composite fringe image. The method overcomes the problem of serious spectrum aliasing caused by multiplexing schemes and can reconstruct high-quality absolute 3D surfaces.

OPTICS EXPRESS (2022)

Article Optics

Single-exposure 3D label-free microscopy based on color-multiplexed intensity diffraction tomography

Ning Zhou, Jiaji Li, Runnan Zhang, Zhidong Bai, Shun Zhou, Qian Chen, Chao Zuo

Summary: This study presents a 3D label-free refractive index imaging technique based on single-exposure intensity diffraction tomography (sIDT) using a color-multiplexed illumination scheme. By capturing the scattering field from different directions and separating monochromatic intensity images, the 3D refractive index distribution of the object can be reconstructed. The method demonstrates reliable performance in label-free, high-throughput, and real-time 3D volumetric biological imaging applications.

OPTICS LETTERS (2022)

Article Optics

Infrared Ocean Image Simulation Algorithm Based on Pierson-Moskowitz Spectrum and Bidirectional Reflectance Distribution Function

Xueqi Chen, Lin Zhou, Meng Zhou, Ajun Shao, Kan Ren, Qian Chen, Guohua Gu, Minjie Wan

Summary: This paper proposes an infrared ocean image simulation algorithm based on the Pierson-Moskowitz spectrum and a bidirectional reflectance distribution function, which can provide more authentic and clear simulation images.

PHOTONICS (2022)

Article Optics

Intensity-guided depth image estimation in long-range lidar

Miao Wu, Yu Lu, Haochen Li, Tianyi Mao, Yanqiu Guan, Labao Zhang, Weiji He, Peiheng Wu, Qian Chen

Summary: Long-range lidar systems often record large but extremely sparse data cubes, making it challenging to accurately estimate depth images. This paper introduces an intensity-guided method that utilizes temporal-spatial correlation to estimate depth images. Preprocessing steps are used to reduce the data size. Experimental results show that this method outperforms other state-of-the-art methods in estimating depth images, particularly in low signal return scenarios.

OPTICS AND LASERS IN ENGINEERING (2022)

Article Instruments & Instrumentation

Observation of Q-switched and continuous wave regimes in Er-doped fiber lasers incorporating a dynamic population grating

Zengrun Wen, Xiulin Fan, Kaile Wang, Weiming Wang, Song Gao, Wenjing Hao, Yuanmei Gao, Yangjian Cai, Liren Zheng

Summary: This study presents a transition from Q-switched state to continuous wave state in an erbium-doped fiber laser, accompanied by irregular mode-hopping. The results showed that the transition between these two states can be achieved by adjusting the pump power. Modulation peaks were observed on both the Q-switched pulse train and the continuous wave background, and the central wavelength fluctuated.

INFRARED PHYSICS & TECHNOLOGY (2024)