4.7 Article

Tracking objects outside the line of sight using 2D intensity images

Journal

SCIENTIFIC REPORTS
Volume 6, Issue -, Pages -

Publisher

NATURE PUBLISHING GROUP
DOI: 10.1038/srep32491

Keywords

-

Funding

  1. X-Rite Chair for Digital Material Appearance
  2. German Research Foundation [HU 2273/2-1]

Ask authors/readers for more resources

The observation of objects located in inaccessible regions is a recurring challenge in a wide variety of important applications. Recent work has shown that using rare and expensive optical setups, indirect diffuse light reflections can be used to reconstruct objects and two-dimensional (2D) patterns around a corner. Here we show that occluded objects can be tracked in real time using much simpler means, namely a standard 2D camera and a laser pointer. Our method fundamentally differs from previous solutions by approaching the problem in an analysis-by-synthesis sense. By repeatedly simulating light transport through the scene, we determine the set of object parameters that most closely fits the measured intensity distribution. We experimentally demonstrate that this approach is capable of following the translation of unknown objects, and translation and orientation of a known object, in real time.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Optics

Calibration scheme for non-line-of-sight imaging setups

Jonathan Klein, Martin Laurenzis, Matthias B. Hullin, Julian Iseringhausen

OPTICS EXPRESS (2020)

Article Computer Science, Software Engineering

Learning to Reconstruct Botanical Trees from Single Images

Bosheng Li, Jacek Kaluzny, Jonathan Klein, Dominik L. Michels, Wojtek Palubicki, Bedrich Benes, Soren Pirk

Summary: A novel method for reconstructing the 3D geometry of botanical trees from single photographs is introduced, addressing the challenges of faithfully reconstructing a tree from single-view sensor data. The method defines a reconstruction pipeline based on three neural networks, using radial bounding volumes to grow realistic branching for the tree crown and evaluating reconstructed geometries with several metrics.

ACM TRANSACTIONS ON GRAPHICS (2021)

Article Engineering, Electrical & Electronic

Comparison of super-resolution and noise reduction for passive single-photon imaging

Martin Laurenzis, Trevor Seets, Emmanuel Bacher, Atul Ingle, Andreas Velten

Summary: Single-photon sensitive image sensors are widely used in passive imaging applications to capture accurate images under challenging lighting conditions and scene motion. By comparing different design choices in the processing pipeline, we have found an effective method to improve signal-to-noise ratio and resolution, achieving excellent reconstruction results for fast-moving objects.

JOURNAL OF ELECTRONIC IMAGING (2022)

Article Optics

Time domain analysis of photon scattering and Huygens-Fresnel back projection

Martin Laurenzis, Frank Christnacher

Summary: In this study, we present a method for stand-off characterization of sprayed water fog in the time domain. By measuring transient signatures of reflected photons and reconstructing the scattered photon paths, we successfully determine the fog's mean scattering length and reconstruct the scene using virtual wavefronts. This research is of great importance for characterization tools and enhanced imaging in scattering media.

OPTICS EXPRESS (2022)

Article Environmental Sciences

Time-correlated single photon counting for evaluation of cavity dimensions with multibounce photons

Martin Laurenzis, Frank Christnacher

Summary: Cavity exploration is crucial for optical remote sensing and has various applications. We utilized single photon-counting avalanche diode cameras to capture changes in cavities and developed analytical models to estimate their sizes. Experimental evaluations showed that our models can provide initial estimates for cavities of different characteristics.

JOURNAL OF APPLIED REMOTE SENSING (2023)

Proceedings Paper Optics

Cavity exploration by laser pulse stretching measurements with single photon counting

F. Christnacher, M. Laurenzis

Summary: The recent development of single-photon avalanche diode (SPAD) based sensors has revolutionized advanced imaging and contributed to the growth of computational imaging. This paper demonstrates the visualization of transient propagation waves in cavities using ultra-short laser pulses and proposes a rapid evaluation method for cavity volume. This method is significant for disaster assessment, geological/archaeological excavations, and extraterrestrial missions.

EMERGING IMAGING AND SENSING TECHNOLOGIES FOR SECURITY AND DEFENCE VII (2022)

Proceedings Paper Optics

Enhanced visual perception through photon counting and computational imaging: What the time and number of photon events can tell us about the world around us

M. Laurenzis, F. Christnacher

Summary: This paper provides an overview of various active and passive SPAD imaging techniques coupled with laser illumination or ambient light, with a focus on military applications. By combining computational imaging, these emerging sensor technologies can access previously inaccessible information and extend the perceptual range of sensors.

EMERGING IMAGING AND SENSING TECHNOLOGIES FOR SECURITY AND DEFENCE VII (2022)

Proceedings Paper Engineering, Electrical & Electronic

Passive imaging of single photon flux: strategies for de-noising, motion blur reduction and super-resolution up-scaling

M. Laurenzis, T. Seets, E. Bacher, A. Ingle, A. Velten

Summary: This study demonstrates the use of single photon-counting avalanche photo-diode (SPAD) to measure the photon flux from uncorrelated single photons, and explores the relationship between the sensor photon count rate and the intensity or radiant flux reflected from surfaces. Various de-noising strategies and the impact of motion blur are examined, along with the application of a fast super-resolution neural network (FSRCNN) to scale images for super-resolution enhancement.

EMERGING IMAGING AND SENSING TECHNOLOGIES FOR SECURITY AND DEFENCE VI (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Motion Adaptive Deblurring with Single-Photon Cameras

Trevor Seets, Atul Ingle, Martin Laurenzis, Andreas Velten

Summary: SPADs are image sensing technology with extreme low-light sensitivity and picosecond timing resolution, used in photon-starved scenarios. Researchers propose an algorithm to estimate pixel motion from SPAD camera data and dynamically adapt integration windows to reduce motion blur. The feasibility of the method is demonstrated on real-world data captured using a 32 x 32 SPAD camera.

2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021) (2021)

Proceedings Paper Quantum Science & Technology

Investigation of some limitations of non-line-of-sight scene reconstruction

Martin Laurenzis

EMERGING IMAGING AND SENSING TECHNOLOGIES FOR SECURITY AND DEFENCE V; AND ADVANCED MANUFACTURING TECHNOLOGIES FOR MICRO- AND NANOSYSTEMS IN SECURITY AND DEFENCE III (2020)

Proceedings Paper Optics

Prediction of MUAV flight behavior from active and passive imaging in complex environment

Martin Laurenzis, Martin Rebert, Stephane Schertzer, Emmanuel Bacher, Frank Christnacher

LASER RADAR TECHNOLOGY AND APPLICATIONS XXV (2020)

Proceedings Paper Optics

60 years of advanced imaging at ISL: from the Cranz-Schardin camera to non-line-of-sight imaging

F. Christnacher, M. Laurenzis, Y. Lutz, A. Matwyschuk

ELECTRO-OPTICAL REMOTE SENSING XIII (2019)

Proceedings Paper Optics

Active and passive computational imaging for tracking and prediction of three-dimensional MUAV flight paths

Martin Laurenzis, Martin Rebert, Emmanuel Bacher, Stephane Schertzer

ELECTRO-OPTICAL REMOTE SENSING XIII (2019)

Proceedings Paper Optics

Tracking and prediction of small unmanned aerial vehicles' flight behavior and three-dimensional flight path from laser gated viewing images

Martin Laurenzis, Martin Rebert, Stephane Schertzer, Frank Christnacher

LASER RADAR TECHNOLOGY AND APPLICATIONS XXIV (2019)

No Data Available