4.7 Article

Physics-Based Learned Design: Optimized Coded-Illumination for Quantitative Phase Imaging

Journal

IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING
Volume 5, Issue 3, Pages 344-353

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TCI.2019.2905434

Keywords

Phase imaging; unrolled network; physics-based; experimental design; illumination design

Funding

  1. STROBE: A National Science Foundation Science & Technology Center [DMR 1548924]
  2. National Science Foundation's Graduate Research Fellowship [DGE 1106400]
  3. Swiss National Science Foundation (SNSF) [P2ELP2 172278]
  4. Gordon and Betty Moore Foundation's Data-Driven Discovery Initiative [GBMF4562]
  5. Swiss National Science Foundation (SNF) [P2ELP2_172278] Funding Source: Swiss National Science Foundation (SNF)

Ask authors/readers for more resources

Coded illumination can enable quantitative phase microscopy of transparent samples with minimal hardware requirements. Intensity images are captured with different source patterns, then a nonlinear phase retrieval optimization reconstructs the image. The nonlinear nature of the processing makes optimizing the illumination pattern designs complicated. The traditional techniques for the experimental design (e. g., condition number optimization, and spectral analysis) consider only linear measurement formation models and linear reconstructions. Deep neural networks (DNNs) can efficiently represent the nonlinear process and can be optimized over via training in an end-to-end framework. However, DNNs typically require a large amount of training examples and parameters to properly learn the phase retrieval process, without making use of the known physical models. In this paper, we aim to use both our knowledge of the physics and the power of machine learning together. We propose a new data-driven approach for optimizing coded-illumination patterns for an LED array microscope for a given phase reconstruction algorithm. Our method incorporates both the physics of the measurement scheme and the nonlinearity of the reconstruction algorithm into the design problem. This enables efficient parameterization, which allows us to use only a small number of training examples to learn designs that generalize well in the experimental setting without retraining. We show experimental results for both a well-characterized phase target and mouse fibroblast cells, using coded-illumination patterns optimized for a sparsity-based phase reconstruction algorithm. Our learned design results using two measurements demonstrate similar accuracy to Fourier ptychography with 69 measurements.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Biochemical Research Methods

High-throughput fluorescence microscopy using multi-frame motion deblurring

Zachary F. Phillips, Sarah Dean, Benjamin Recht, Laura Waller

BIOMEDICAL OPTICS EXPRESS (2020)

Article Optics

Untrained networks for compressive lensless photography

Kristina Monakhova, Vi Tran, Grace Kuo, Laura Waller

Summary: Compressive lensless imagers enable novel applications in an extremely compact device, recovering 3D data from 2D measurements through compressive-sensing-based inverse problems. This work proposes an unsupervised approach based on untrained networks for compressive image recovery, demonstrating improved image quality without the need for labeled training data.

OPTICS EXPRESS (2021)

Article Optics

Image denoising for fluorescence microscopy by supervised to self-supervised transfer learning

Yina Wang, Henry Pinkard, Emaad Khwaja, Shuqin Zhou, Laura Waller, Bo Huang

Summary: When studying cellular dynamics with fluorescent microscopy, trade-offs need to be made between light exposure and image quality, with image denoising playing a key role. Deep learning based image denoising has shown promising results by incorporating prior knowledge and temporal information. However, challenges arise due to the need for large training datasets, which can be addressed by combining self-supervised learning with transfer learning to maintain denoising performance without task-specific training data.

OPTICS EXPRESS (2021)

Article Biochemical Research Methods

Self-calibrated 3D differential phase contrast microscopy with optimized illumination

Ruiming Cao, Michael Kellman, David Ren, Regina Eckert, Laura Waller

Summary: We present a practical extension of the 3D differential phase contrast (DPC) method that does not require precise motion stage scanning, but uses a hand-scanning approach with automatic axial position calibration. The algorithm solves for the 3D refractive index of the sample through computational inverse problem. The method also incorporates optimized illumination patterns for improved performance.

BIOMEDICAL OPTICS EXPRESS (2022)

Article Optics

Deep learning for fast spatially varying deconvolution

Kyrollos Yanny, Kristina Monakhova, Richard W. Shuai, Laura Waller

Summary: In this study, we propose a deep-learning-based approach that leverages knowledge about the system's spatially varying point spread function (PSF) for fast 2D and 3D reconstructions. Our method outperforms traditional iterative methods in terms of speed and performance.

OPTICA (2022)

Review Optics

Recent advances in lensless imaging

Vivek Boominathan, Jacob T. Robinson, Laura Waller, Ashok Veeraraghavan

Summary: This article reviews recent advances in lensless imaging technology and describes the design principles to be considered when developing and using lensless imaging systems.

OPTICA (2022)

Article Multidisciplinary Sciences

Ion complexation waves emerge at the curved interfaces of layered minerals

Michael L. Whittaker, David Ren, Colin Ophus, Yugang Zhang, Laura Waller, Benjamin Gilbert, Jillian F. Banfield

Summary: This study investigates the visualization of hydrated interfaces and proposes a new method for direct imaging the electric double layer (EDL) structure of layered minerals. The presence of hydrated ion waves and their interactions with minerals are revealed. This research is of great significance for understanding geochemical processes and mineral behavior.

NATURE COMMUNICATIONS (2022)

Article Engineering, Electrical & Electronic

A MEMS-Based Optical Scanning System for Precise, High-Speed Neural Interfacing

Cem Yalcin, Nathan Tessema Ersaro, Mohammad Meraj Ghanbari, George Bocchetti, Sina Faraji Alamouti, Nick Antipa, Daniel Lopez, Nicolas C. Pegard, Laura Waller, Rikky Muller

Summary: This article presents a varifocal mirror consisting of an array of piston-motion MEMS micromirrors and a custom ASIC, offering fast operation with dwelling capability and high diffraction efficiency.

IEEE JOURNAL OF SOLID-STATE CIRCUITS (2022)

Editorial Material Biochemical Research Methods

Microscopes are coming for your job

Henry Pinkard, Laura Waller

Summary: Advancements in microscopy, computer vision, and open source software are coming together to introduce a new era of self-controlling microscopes.

NATURE METHODS (2022)

Article Biochemical Research Methods

Three- dimensional bi-functional refractive index and fluorescence microscopy (BRIEF)

Yi Xue, David Ren, Laura Waller

Summary: Fluorescence microscopy and phase microscopy provide imaging and label-free measurement of refractive index (RI) of biological samples, respectively. This study proposes a new computational multi-modal imaging method based on epi-mode microscopy to reconstruct both 3D fluorescence and 3D RI, enabling the digital correction of multiple-scattering effects in fluorescence images.

BIOMEDICAL OPTICS EXPRESS (2022)

Article Optics

DiffuserSpec: spectroscopy with Scotch tape

Joseph D. Malone, Neerja Aggarwal, Laura Waller, Audrey K. Bowden

Summary: Computational spectroscopy breaks the traditional one-to-one spatial-to-spectral pixel mapping by multiplexing spectral data over a sensor region. DiffuserSpec is a simple computational spectrometer that uses commercially available diffusers to generate unique speckle patterns for each wavelength. Using Scotch tape as a diffuser, we demonstrate narrowband and broadband spectral reconstructions with 2-nm resolution over an 85-nm bandwidth in the near-infrared.

OPTICS LETTERS (2023)

Correction Optics

Quantitative differential phase contrast imaging in an LED array microscope (vol 23, pg 11394, 2015)

Lei Tian, Laura Waller

Summary: This errata corrects typographical errors in the derived transfer functions in [Opt. Express 23, 11394 (2015)].

OPTICS EXPRESS (2023)

Correction Optics

Miniscope3D: optimized single-shot miniature 3D fluorescence microscopy (vol 9, 171, 2020)

Kyrollos Yanny, Nick Antipa, William Liberti, Sam Dehaeck, Kristina Monakhova, Fanglin Linda Liu, Konlin Shen, Ren Ng, Laura Waller

LIGHT-SCIENCE & APPLICATIONS (2023)

Article Optics

Exceeding the limits of algorithmic self-calibrated aberration recovery in Fourier ptychography

Eric Li, Stuartq Sherwin, Gautam Gunjala, Laura Waller

Summary: Fourier ptychographic microscopy is a computational imaging technique that provides high-resolution images with quantitative phase information over a large field-of-view. Model mismatch caused by unknown optical aberrations can limit reconstruction quality, but a separate calibration process can improve accuracy.

OPTICS CONTINUUM (2023)

No Data Available