4.8 Article

Single-frame 3D fluorescence microscopy with ultraminiature lensless FlatScope

期刊

SCIENCE ADVANCES
卷 3, 期 12, 页码 -

出版社

AMER ASSOC ADVANCEMENT SCIENCE
DOI: 10.1126/sciadv.1701548

关键词

-

资金

  1. NSF [CCF-1502875, CCF-1527501, IIS-1652633]
  2. Defense Advanced Research Projects Agency [N66001-17-C-4012]
  3. Division of Computing and Communication Foundations
  4. Direct For Computer & Info Scie & Enginr [1527501] Funding Source: National Science Foundation

向作者/读者索取更多资源

Modern biology increasingly relies on fluorescence microscopy, which is driving demand for smaller, lighter, and cheaper microscopes. However, traditional microscope architectures suffer from a fundamental trade-off: As lenses becomesmaller, theymust either collect less light or image a smaller field of view. To break this fundamental trade-off between device size and performance, we present a new concept for three-dimensional (3D) fluorescence imaging that replaces lenses with an optimized amplitude mask placed a few hundred micrometers above the sensor and an efficient algorithm that can convert a single frame of captured sensor data into high-resolution 3D images. The result is FlatScope: perhaps the world's tiniest and lightest microscope. FlatScope is a lensless microscope that is scarcely larger than an image sensor (roughly 0.2 g in weight and less than 1mmthick) and yet able to produce micrometer-resolution, high-frame rate, 3D fluorescence movies covering a total volume of several cubic millimeters. The ability of FlatScope to reconstruct full 3Dimages froma single frame of captured sensor data allows us to image 3Dvolumes roughly 40,000 times faster than a laser scanning confocal microscope while providing comparable resolution. We envision that this new flat fluorescence microscopy paradigm will lead to implantable endoscopes that minimize tissue damage, arrays of imagers that cover large areas, and bendable, flexible microscopes that conform to complex topographies.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.8
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Computer Science, Artificial Intelligence

Uniform Partitioning of Data Grid for Association Detection

Ali Mousavi, Richard G. Baraniuk

Summary: This article introduces a method called the uniform information coefficient (UIC), which is able to infer relationships among variables from large datasets. Compared to traditional methods, the UIC calculation is more efficient and robust to the type of association between variables.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Review Optics

Recent advances in lensless imaging

Vivek Boominathan, Jacob T. Robinson, Laura Waller, Ashok Veeraraghavan

Summary: This article reviews recent advances in lensless imaging technology and describes the design principles to be considered when developing and using lensless imaging systems.

OPTICA (2022)

Article Engineering, Civil

Near-Infrared Imaging Photoplethysmography During Driving

Ewa M. Nowara, Tim K. Marks, Hassan Mansour, Ashok Veeraraghavan

Summary: Imaging photoplethysmography (iPPG) has the potential to enhance driver safety systems by detecting driver fatigue and early heart failure in a non-invasive manner. However, iPPG faces challenges in the driving context due to illumination and motion. This paper proposes two innovations to overcome these challenges: using narrow-band near-infrared video recordings to reduce illumination variations, and introducing a novel optimization algorithm called AutoSparsePPG that improves performance compared to existing methods.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2022)

Article Engineering, Biomedical

In vivo lensless microscopy via a phase mask generating diffraction patterns with high-contrast contours

Jesse K. Adams, Dong Yan, Jimin Wu, Vivek Boominathan, Sibo Gao, Alex Rodriguez, Soonyoung Kim, Jennifer Carns, Rebecca Richards-Kortum, Caleb Kemere, Ashok Veeraraghavan, Jacob T. Robinson

Summary: Lensless microscopy with a designed phase mask allows for imaging of biological tissue in vivo, overcoming the limitations of existing techniques. The low-cost and small form factor of this lensless imaging method makes it suitable for clinical use in inaccessible areas of the body.

NATURE BIOMEDICAL ENGINEERING (2022)

Article Optics

FlatNet3D: intensity and absolute depth from single-shot lensless capture

Dhruvjyoti Bagadthey, Sanjana Prabhu, Salman S. Khan, D. Tony Fredrick, Vivek Boominathan, Ashok Veeraraghavan, Kaushik Mitra

Summary: This paper proposes a feed-forward deep network called FlatNet3D that can directly reconstruct depth and intensity information from a single lensless capture. The algorithm is fast and produces high-quality results, utilizing an efficient physics-based 3D mapping stage and a fully convolutional network. The effectiveness of the proposed method is validated through simulations and real scenes captured using PhlatCam.

JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION (2022)

Article Multidisciplinary Sciences

NeuWS: Neural wavefront shaping for guidestar-free imaging through static and dynamic scattering media

Brandon Y. Feng, Haiyun Guo, Mingyang Xie, Vivek Boominathan, Manoj K. Sharma, Ashok Veeraraghavan, Christopher A. Metzler

Summary: We propose a scanning-free wavefront shaping technique called neural wavefront shaping (NeuWS) that integrates maximum likelihood estimation, measurement modulation, and neural signal representations to reconstruct diffraction-limited images through strong static and dynamic scattering media without guidestars, sparse targets, controlled illumination, nor specialized image sensors.

SCIENCE ADVANCES (2023)

Article Engineering, Electrical & Electronic

High-Speed Time-Domain Diffuse Optical Tomography With a Sensitivity Equation-Based Neural Network

Fay Wang, Stephen H. Kim, Yongyi Zhao, Ankit Raghuram, Ashok Veeraraghavan, Jacob Robinson, Andreas H. Hielscher

Summary: Steady progress in time-domain diffuse optical tomography (TD-DOT) technology has resulted in the development of low-cost, compact, and high-performance systems, enabling widespread clinical TD-DOT use. The new algorithm, SENSOR-NET, combines a deep-learning approach with a non-iterative sparse optical reconstruction code to achieve high-resolution sparse reconstruction without the need for parameter tuning. This allows for real-time brain monitoring and other high-speed TD-DOT applications.

IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING (2023)

Article Computer Science, Artificial Intelligence

Covariate Balancing Methods for Randomized Controlled Trials Are Not Adversarially Robust

Hossein Babaei, Sina Alemohammad, Richard G. Baraniuk

Summary: To investigate treatment effectiveness, populations are split into control and treatment groups and their average responses are compared. Similarity in statistics of these groups is crucial for reliable and valid results. Covariate balancing methods aim to increase similarity, but limited samples often hinder accurate estimation. This article uncovers that covariate balancing measures and sequential treatment assignment methods can be susceptible to worst case treatment assignments, resulting in high estimation errors. An adversarial attack is developed to find such assignments and an optimization-based algorithm (ATASTREET) is provided to measure the closeness to worst-case scenarios.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Proceedings Paper Computer Science, Artificial Intelligence

PANDORA: Polarization-Aided Neural Decomposition of Radiance

Akshat Dave, Yongyi Zhao, Ashok Veeraraghavan

Summary: Inverse rendering, a fundamental problem in computer graphics and vision, has benefited from recent advancements in neural networks and polarization sensors, allowing for impressive geometry reconstruction and reflectance estimation.

COMPUTER VISION, ECCV 2022, PT VII (2022)

Article Engineering, Electrical & Electronic

On Local Distributions in Graph Signal Processing

T. Mitchell Roddenberry, Fernando Gama, Richard G. G. Baraniuk, Santiago Segarra

Summary: Graph filtering is a fundamental operation in graph signal processing, with its output depending only on the local neighborhood of each node. This research proposes a framework based on the local distribution of a graph, allowing for comparison of graphs of different sizes and models, and obtaining related properties.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2022)

Proceedings Paper Computer Science, Hardware & Architecture

EyeCoD: Eye Tracking System Acceleration via FlatCam-based Algorithm & Accelerator Co-Design

Haoran You, Cheng Wan, Yang Zhao, Zhongzhi Yu, Yonggan Fu, Jiayi Yuan, Shang Wu, Shunyao Zhang, Yongan Zhang, Chaojian Li, Vivek Boominathan, Ashok Veeraraghavan, Ziyun Li, Yingyan Lin

Summary: The study proposes a lensless FlatCam-based eye tracking algorithm and accelerator co-design framework, which significantly reduces the form-factor of eye tracking systems and improves system efficiency without sacrificing tracking accuracy.

PROCEEDINGS OF THE 2022 THE 49TH ANNUAL INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE (ISCA '22) (2022)

Article Engineering, Electrical & Electronic

Extreme Compressed Sensing of Poisson Rates From Multiple Measurements

Pavan K. Kota, Daniel LeJeune, Rebekah A. Drezek, Richard G. Baraniuk

Summary: Compressed sensing is a signal processing technique that efficiently recovers sparse high-dimensional signals from low-dimensional measurements. This study explores the multiple measurement vector problem where signals are independently drawn from a sparse multivariate Poisson distribution. Through maximum likelihood estimation and a novel Sparse Poisson Recovery algorithm, the sparse parameter vector of Poisson rates is successfully recovered.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2022)

Article Pediatrics

An Objective System for Quantitative Assessment of Television Viewing Among Children (Family Level Assessment of Screen Use in the Home-Television): System Development Study

Anil Kumar Vadathya, Salma Musaad, Alicia Beltran, Oriana Perez, Leo Meister, Tom Baranowski, Sheryl O. Hughes, Jason A. Mendoza, Ashutosh Sabharwal, Ashok Veeraraghavan, Teresia O'Connor

Summary: The FLASH-TV system offers a critical step forward in improving the assessment of children's television viewing.

JMIR PEDIATRICS AND PARENTING (2022)

Article Geochemistry & Geophysics

Recurrent Scattering Network Detects Metastable Behavior in Polyphonic Seismo-Volcanic Signals for Volcano Eruption Forecasting

Angel Bueno Rodriguez, Randall Balestriero, Silvio De Angelis, M. Carmen Benitez, Luciano Zuccarello, Richard Baraniuk, Jesus M. Ibanez, Maarten de Hoop

Summary: This paper introduces an automatic neural network architecture for seismic and volcanic monitoring. By using a Bayesian network strategy and scattering transform, changes in seismic and volcanic activity can be detected, which can help predict possible volcanic eruptions.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Proceedings Paper Computer Science, Artificial Intelligence

SACoD: Sensor Algorithm Co-Design Towards Efficient CNN-powered Intelligent PhlatCam

Yonggan Fu, Yang Zhang, Yue Wang, Zhihan Lu, Vivek Boominathan, Ashok Veeraraghavan, Yingyan Lin

Summary: The demand for integrating CNN functionalities into IoT devices is booming, yet faces challenges in shape requirements and limited resources. PhlatCam and the SACoD framework offer promising solutions to address these challenges in more efficient CNN-powered IoT cameras.

2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021) (2021)

暂无数据