4.6 Article

Learning from simulation: An end-to-end deep-learning approach for computational ghost imaging

期刊

OPTICS EXPRESS
卷 27, 期 18, 页码 25560-25572

出版社

Optica Publishing Group
DOI: 10.1364/OE.27.025560

关键词

-

类别

资金

  1. Chinese Academy of Sciences [QYZDB-SSW-JSC002]
  2. Sino-German Center [GZ 1391]

向作者/读者索取更多资源

Artificial intelligence (AI) techniques such as deep learning (DL) for computational imaging usually require to experimentally collect a large set of labeled data to train a neural network. Here we demonstrate that a practically usable neural network for computational imaging can be trained by using simulation data. We take computational ghost imaging (CGI) as an example to demonstrate this method. We develop a one-step end-to-end neural network, trained with simulation data, to reconstruct two-dimensional images directly from experimentally acquired one-dimensional bucket signals, without the need of the sequence of illumination patterns. This is in particular useful for image transmission through quasi-static scattering media as little care is needed to take to simulate the scattering process when generating the training data. We believe that the concept of training using simulation data can be used in various DL-based solvers for general computational imaging. (C) 2019 Optical Society of America under the terms of the OSA Open Access Publishing Agreement

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Optics

Roadmap on chaos-inspired imaging technologies (CI2-Tech)

Joseph Rosen, Hilton B. de Aguiar, Vijayakumar Anand, YoonSeok Baek, Sylvain Gigan, Ryoichi Horisaki, Herve Hugonnet, Saulius Juodkazis, KyeoReh Lee, Haowen Liang, Yikun Liu, Stephan Ludwig, Wolfgang Osten, YongKeun Park, Giancarlo Pedrini, Tushar Sarkar, Johannes Schindler, Alok Kumar Singh, Rakesh Kumar Singh, Guohai Situ, Mitsuo Takeda, Xiangsheng Xie, Wanqin Yang, Jianying Zhou

Summary: In recent years, the rapid development of chaos-inspired imaging technologies, consisting of non-invasive and invasive directions, has led to faster and smarter imaging capabilities. Non-invasive imaging through scattering layers has achieved significant progress, while invasive imaging exploits chaos to achieve special imaging characteristics and increase dimensionalities beyond the limits of conventional imagers. This roadmap presents the current and future challenges in both invasive and non-invasive imaging technologies.

APPLIED PHYSICS B-LASERS AND OPTICS (2022)

Article Physics, Applied

BlindNet: an untrained learning approach toward computational imaging with model uncertainty

Xiangyu Zhang, Fei Wang, Guohai Situ

Summary: The solution of an inverse problem in computational imaging often relies on accurate knowledge of the physical model and object, but model uncertainty in practical applications can degrade the quality of reconstructed images. In this paper, we propose a novel untrained learning approach to address computational imaging with model uncertainty, demonstrated through phase retrieval, an important task in biomedical imaging and industrial inspection.

JOURNAL OF PHYSICS D-APPLIED PHYSICS (2022)

Article Optics

Far-field super-resolution ghost imaging with a deep neural network constraint

Fei Wang, Chenglong Wang, Mingliang Chen, Wenlin Gong, Yu Zhang, Shensheng Han, Guohai Situ

Summary: Ghost imaging (GI) is a technique that facilitates image acquisition under low-light conditions by single-pixel measurements, and has great potential in various applications. However, the current GI techniques require a large number of samples to reconstruct high-resolution images, which limits their practical applications. In this study, a far-field super-resolution GI technique is proposed that incorporates the physical model for GI image formation into a deep neural network. The proposed technique outperforms other widespread GI techniques in terms of spatial resolution and sampling ratio, and provides a new framework for GI with practical applications.

LIGHT-SCIENCE & APPLICATIONS (2022)

Article Optics

Single-pixel imaging using physics enhanced deep learning

Fei Wang, Chenglong Wang, Chenjin Deng, Shensheng Han, Guohai Situ

Summary: This study proposes a physics-enhanced deep learning approach for image reconstruction in single-pixel imaging. By combining a physics-informed layer and a model-driven fine-tuning process, the proposed method demonstrates generalizability and outperforms other widespread algorithms in terms of both robustness and fidelity.

PHOTONICS RESEARCH (2022)

Article Optics

Light-sheet light-field fluorescence microscopy

Dong Liang, Xiaoting Peng, Yuyao Hu, Fu Zhao, Shanshan Zheng, Guohai Situ, Jun Liu

Summary: Light sheet fluorescence microscopy (LSFM) using light field imaging can improve axial resolution and provide high axial resolution and large field of view without losing spatial resolution.

OPTICS AND LASERS IN ENGINEERING (2022)

Article Optics

Single-shot noninvasive imaging through scattering medium under white-light illumination

Dajiang Lu, Qi Xing, Meihua Liao, Guohai Situ, Xiang Peng, Wenqi He

Summary: In this study, we experimentally investigate image reconstruction through a scattering medium under white-light illumination. A modified iterative algorithm with a constraint on the optical transfer function (OTF) is used to solve the inverse problem of noninvasive scattering imaging. The proposed method shows a potential advantage in scattering imaging compared to the well-known speckle correlation technique (SCT).

OPTICS LETTERS (2022)

Article Optics

Optical random micro-phase-shift DropConnect in a diffractive deep neural network

Yong-Liang Xiao, Sikun Li, Guohai Situ, Jianxin Zhong

Summary: This Letter presents a unitary neural network based on optical random phase DropConnect, which introduces a micro-phase to achieve training convergence and enhance statistical inference. The study reveals that the partial drilling of random micro-phase-shift outperforms the full-drilling counterpart in both training and inference.

OPTICS LETTERS (2022)

Article Nanoscience & Nanotechnology

VGenNet: Variable Generative Prior Enhanced Single Pixel Imaging

Xiangyu Zhang, Chenjin Deng, Chenglong Wang, Fei Wang, Guohai Situ

Summary: Single-pixel imaging (SPI) converts a multi-dimensional image acquisition problem into a one-dimensional temporal-signal detection problem, and efficient SPI techniques are crucial for image reconstruction. Deep learning has shown superiority in SPI, but is task-specific and requires retraining for different problems. The proposed VGenNet algorithm incorporates a model-driven fine-tuning process into a generative model, allowing the use of a pretrained model for various inverse imaging problems. Experimental results demonstrate the high-quality image reconstruction and flexibility of VGenNet.

ACS PHOTONICS (2023)

Article Optics

Fourier ptychographic topography

Hao Wang, Jiabei Zhu, Jangwoon Sung, Guorong Hu, Joseph Greene, Yunzhe LI, Seungbeom Park, Wookrae Kim, Myungjun Lee, Yusin Yang, Lei Tian

Summary: Topography measurement is crucial for surface characterization and inspection applications. This study presents a novel topography technique called Fourier ptychographic topography (FPT), which combines a computational microscope and a phase retrieval algorithm to achieve wide-field-of-view and high-resolution topography reconstruction with nanoscale accuracy. FPT has important implications for surface characterization, semiconductor metrology, and inspection applications.

OPTICS EXPRESS (2023)

Article Nanoscience & Nanotechnology

Defogging lens design for infrared laser active imaging by orbital angular momentum meta-surface

Jinming Gao, Jinying Guo, Anli Dai, Guohai Situ

Summary: Imaging in scattering media has always been a major challenge due to the interference of background noise with the object information carried by ballistic light, resulting in poor image quality. To address this, active illumination imaging technology offers various advantages over passive imaging by introducing controllable parameters like polarization and coded aperture. In this study, we successfully introduced orbital angular momentum into scattering imaging, effectively enhancing the mid/high frequency components of the object. Furthermore, we fused the enhanced image with the low-quality image obtained from traditional imaging, leading to significant improvements in signal-to-noise ratio and image contrast. This method holds potential applications in foggy environments for autonomous driving, lidar, and machine vision.

AIP ADVANCES (2023)

Article Optics

Lensless complex amplitude demodulation based on deep learning in holographic data storage

Jianying Hao, Xiao Lin, Yongkun Lin, Mingyong Chen, Ruixian Chen, Guohai Situ, Hideyoshi Horimai, Xiaodi Tan

Summary: In this study, a complex amplitude demodulation method based on deep learning was proposed for holographic data storage. A single-shot diffraction intensity image was used to demodulate both the amplitude and phase by analyzing the correlation between the diffraction intensity features and the encoding data pages. This method achieved multilevel complex amplitude demodulation experimentally without iterations for the first time in HDS.

OPTO-ELECTRONIC ADVANCES (2023)

Article Chemistry, Multidisciplinary

Arbitrary Jones matrix on-demand design in metasurfaces using multiple meta-atoms

Guocui Wang, Jinying Guo, Xinke Wang, Bin Hu, Guohai Situ, Yan Zhang

Summary: This article introduces the methods of using super cells or multi-layer metasurfaces to achieve various multi-functional and exotic functional devices. By mathematically describing the Jones matrix, the computational requirements can be reduced, and devices with various functions can be constructed.

NANOSCALE (2022)

Article Astronomy & Astrophysics

Intelligent orbital angular momentum recognition of a scattered vortex beam

Situ GuoHai

Summary: Scattering of coherent light and coherent vortex beams propagating through a segment of a multi-mode fiber both produce speckle. Recognizing the orbital angular momentum of the incident vortex beam from the output speckle becomes significantly important for vortex beam study and mode division multiplexing, and deep learning is demonstrated as an efficient approach to address this problem.

SCIENTIA SINICA-PHYSICA MECHANICA & ASTRONOMICA (2022)

Article Optics

Hybrid-Convolution-Based Reconstruction for Limited-View Emission Spectrum Tomography

Zhu Sunyong, Jin Ying, Wu Quanying, Liu Haishan, Situ Guohai

Summary: A hybrid neural network model based on 3D-2D convolution tandem is proposed to overcome the problem of low accuracy in practical flame reconstruction. The model uses 3D convolution to extract spatial features from multiple views and 2D convolution to accelerate training speed. Compared to traditional algorithms, the proposed model achieves higher accuracy with lower time consumption.

ACTA OPTICA SINICA (2022)

Article Optics

Image encryption using spatial nonlinear optics

Junfeng Hou, Guohai Situ

Summary: Optical technologies have been widely used in information security, but the linearity issue in current optical encryption techniques makes the system vulnerable to attacks. Recent research shows that a true nonlinear optical encryption technique can be achieved by utilizing the self-phase modulation effect of photorefractive crystals, providing robustness against known plaintext attacks.

ELIGHT (2022)

暂无数据