4.8 Article

First-Photon Imaging

Journal

SCIENCE
Volume 343, Issue 6166, Pages 58-61

Publisher

AMER ASSOC ADVANCEMENT SCIENCE
DOI: 10.1126/science.1246775

Keywords

-

Funding

  1. Defense Advanced Research Projects Agency InPho program through U.S. Army Research Office [W911NF-10-1-0404]
  2. U.S. NSF [1161413]
  3. Qualcomm Innovation Fellowship
  4. Samsung Scholarship
  5. Microsoft Ph.D. Fellowship
  6. Division of Computing and Communication Foundations
  7. Direct For Computer & Info Scie & Enginr [1161413] Funding Source: National Science Foundation

Ask authors/readers for more resources

Imagers that use their own illumination can capture three-dimensional (3D) structure and reflectivity information. With photon-counting detectors, images can be acquired at extremely low photon fluxes. To suppress the Poisson noise inherent in low-flux operation, such imagers typically require hundreds of detected photons per pixel for accurate range and reflectivity determination. We introduce a low-flux imaging technique, called first-photon imaging, which is a computational imager that exploits spatial correlations found in real-world scenes and the physics of low-flux measurements. Our technique recovers 3D structure and reflectivity from the first detected photon at each pixel. We demonstrate simultaneous acquisition of sub-pulse duration range and 4-bit reflectivity information in the presence of high background noise. First-photon imaging may be of considerable value to both microscopy and remote sensing.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.8
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Multidisciplinary Sciences

Computational periscopy with an ordinary digital camera

Charles Saunders, John Murray-Bruce, Vivek K. Goyal

NATURE (2019)

Article Engineering, Electrical & Electronic

Dead Time Compensation For High-Flux Ranging

Joshua Rapp, Yanting Ma, Robin M. A. Dawson, Vivek K. Goyal

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2019)

Article Engineering, Electrical & Electronic

Estimation From Quantized Gaussian Measurements: When and How to Use Dither

Joshua Rapp, Robin M. A. Dawson, Vivek K. Goyal

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2019)

Article Engineering, Electrical & Electronic

Beliefs in Decision-Making Cascades

Daewon Seo, Ravi Kiran Raman, Joong Bum Rhim, Vivek K. Goyal, Lav R. Varshney

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2019)

Article Engineering, Electrical & Electronic

Beyond Binomial and Negative Binomial: Adaptation in Bernoulli Parameter Estimation

Safa C. Medin, John Murray-Bruce, David Castanon, Vivek K. Goyal

IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING (2019)

Article Engineering, Electrical & Electronic

Advances in Single-Photon Lidar for Autonomous Vehicles: Working Principles, Challenges, and Recent Advances

Joshua Rapp, Julian Tachella, Yoann Altmann, Stephen McLaughlin, Vivek K. Goyal

IEEE SIGNAL PROCESSING MAGAZINE (2020)

Article Multidisciplinary Sciences

Seeing around corners with edge-resolved transient imaging

Joshua Rapp, Charles Saunders, Julian Tachella, John Murray-Bruce, Yoann Altmann, Jean-Yves Tourneret, Stephen McLaughlin, Robin M. A. Dawson, Franco N. C. Wong, Vivek K. Goyal

NATURE COMMUNICATIONS (2020)

Article Optics

High-flux single-photon lidar

Joshua Rapp, Yanting Ma, Robin M. A. Dawson, Vivek K. Goyal

Summary: This study demonstrates a method for measurements at higher incident flux without attenuation by accurately modeling the sequence of detection times as a Markov chain. The proposed algorithm corrects for the distortion in detection histograms caused by dead times, improving depth imaging performance significantly. This approach could potentially enable high-flux acquisitions in other fields such as fluorescence lifetime microscopy or quantum optics applications.

OPTICA (2021)

Article Multidisciplinary Sciences

Non-line-of-sight imaging over 1.43 km

Cheng Wu, Jianjiang Liu, Xin Huang, Zheng-Ping Li, Chao Yu, Jun-Tian Ye, Jun Zhang, Qiang Zhang, Xiankang Dou, Vivek K. Goyal, Feihu Xu, Jian-Wei Pan

Summary: NLOS imaging reconstructs hidden objects from indirect light paths, achieving breakthroughs in long-range imaging. Hardware and software innovations have successfully increased the standoff distance of NLOS imaging, opening up new possibilities for related applications.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2021)

Article Optics

Compressively sampling the optical transmission matrix of a multimode fibre

Shuhui Li, Charles Saunders, Daniel J. Lum, John Murray-Bruce, Vivek K. Goyal, Tomas Cizmar, David B. Phillips

Summary: This paper discusses how compressive sensing can reduce the measurement requirements of optical transmission matrices (TMs), allowing for accurate estimation from fewer measurements, and demonstrates this concept on a multimode fiber. The compressive TM sampling strategy is general and applicable to various scattering samples.

LIGHT-SCIENCE & APPLICATIONS (2021)

Article Engineering, Electrical & Electronic

Online Beam Current Estimation in Particle Beam Microscopy

Sheila W. Seidel, Luisa Watkins, Minxu Peng, Akshay Agarwal, Christopher Yu, Vivek K. Goyal

Summary: This work presents a method for online estimation of beam current in particle beam microscopy using the same secondary electron count data. The method relies on time-resolved measurement concept and joint estimators to improve micrograph accuracy. The proposed estimators outperform existing methods and allow for explicit beam current estimation that greatly enhances the quality of micrographs.

IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING (2022)

Article Engineering, Electrical & Electronic

Time-Resolved Focused Ion Beam Microscopy: Modeling, Estimation Methods, and Analyses

Minxu Peng, John Murray-Bruce, Vivek K. Goyal

Summary: This paper establishes a rigorous framework for understanding the potential of using time-resolved measurements in FIB microscopy. By joint processing multiple time-resolved measurements, the impact of source shot noise can be mitigated, leading to substantial improvements in image formation over conventional FIB microscopy. Simulated results are consistent with theoretical analyses, demonstrating the effectiveness of time-resolved measurements.

IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING (2021)

Article Engineering, Electrical & Electronic

Two-Dimensional Non-Line-of-Sight Scene Estimation From a Single Edge Occluder

Sheila W. Seidel, John Murray-Bruce, Yanting Ma, Christopher Yu, William T. Freeman, Vivek K. Goyal

Summary: Passive non-line-of-sight imaging methods are faster and stealthier than active counterparts, leveraging the motion of an occluder or hidden scene. These methods require less complex equipment, with the edge of a wall serving as an aperture to image the hidden region. Light from around the corner is cast onto the floor forming a fan-like penumbra containing information about the hidden scene.

IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING (2021)

Article Optics

Dithered depth imaging

Joshua Rapp, Robin M. A. Dawson, Vivek K. Goyal

OPTICS EXPRESS (2020)

Proceedings Paper Acoustics

TEAM DECISION MAKING WITH SOCIAL LEARNING: HUMAN SUBJECT EXPERIMENTS

Joong Bum Rhim, Vivek K. Goyal

2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) (2018)

No Data Available