4.5 Article

Real-Time Processing of Two-Photon Calcium Imaging Data Including Lateral Motion Artifact Correction

Journal

FRONTIERS IN NEUROINFORMATICS
Volume 12, Issue -, Pages -

Publisher

FRONTIERS MEDIA SA
DOI: 10.3389/fninf.2018.00098

Keywords

two-photon calcium imaging; real-time image processing; image registration; closed-loop experiments; motion artifacts

Funding

  1. NIH [R01 NS091010A, R01 EY025349, R01 DC014690, U01 NS094342, P30EY022589]
  2. Pew Charitable Trusts
  3. David & Lucile Packard Foundation
  4. McKnight Foundation
  5. New York Stem Cell Foundation
  6. Kavli Institute for Brain Mind
  7. NSF [1734940]
  8. Nakajima Foundation
  9. Div Of Electrical, Commun & Cyber Sys
  10. Directorate For Engineering [1734940] Funding Source: National Science Foundation

Ask authors/readers for more resources

Two-photon calcium imaging has been extensively used to record neural activity in the brain. It has been long used solely with post-hoc analysis, but the recent efforts began to include closed-loop experiments. Closed-loop experiments pose new challenges because they require fast, real-time image processing without iterative parameter tuning. When imaging awake animals, one of the crucial steps of post hoc image analysis is correction of lateral motion artifacts. In most of the closed-loop experiments, this step has not been implemented and ignored due to technical difficulties. We recently reported the first experiments with real-time processing of calcium imaging that included lateral motion correction. Here, we report the details of the implementation of fast motion correction and present performance analysis across several algorithms with different parameters. Additionally, we introduce a novel method to estimate baseline calcium signal using kernel density estimate, which reduces the number of parameters to be tuned. Combined, we propose a novel software pipeline of real-time image processing suited for closed-loop experiments. The pipeline is also useful for rapid post hoc image processing.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Neurosciences

Plasticity in olfactory bulb circuits

An Wu, Bin Yu, Takaki Komiyama

CURRENT OPINION IN NEUROBIOLOGY (2020)

Article Neurosciences

Stability of motor cortex network states during learning-associated neural reorganizations

Zhengyu Ma, Haixin Liu, Takaki Komiyama, Ralf Wessel

JOURNAL OF NEUROPHYSIOLOGY (2020)

Article Chemistry, Multidisciplinary

Autonomous Computing Materials

Mark Bathe, Rigoberto Hernandez, Takaki Komiyama, Raghu Machiraju, Sanghamitra Neogi

Summary: Conventional materials are facing limitations in computation, sensing, and data storage, while the human brain excels in integrated sensing, computation, and data storage with minimal energy consumption. The proposed autonomous computing materials aim to mimic the brain's capabilities for integrated functions, offering transformative opportunities for distributed, multimodal sensing, computation, and data storage.

ACS NANO (2021)

Article Neurosciences

Characterizing Cortex-Wide Dynamics with Wide-Field Calcium Imaging

Chi Ren, Takaki Komiyama

Summary: Wide-field calcium imaging, combined with genetically encoded calcium indicators, allows for real-time capture of cortex-wide dynamics in behaving animals and has revealed unprecedented scale of cortical dynamics during various cognitive processes.

JOURNAL OF NEUROSCIENCE (2021)

Article Neurosciences

Multimodal neural recordings with Neuro-FITM uncover diverse patterns of cortical-hippocampal interactions

Xin Liu, Chi Ren, Yichen Lu, Yixiu Liu, Jeong-Hoon Kim, Stefan Leutgeb, Takaki Komiyama, Duygu Kuzum

Summary: The authors introduced a flexible, insertable, and transparent microelectrode array, Neuro-FITM, for multimodal recordings of cortical and hippocampal activity patterns. They demonstrated that diverse cortical activity patterns accompanied hippocampal sharp-wave ripples, with cortical activation often preceding the ripples. This suggests a selective and diverse interaction between hippocampal and large-scale cortical activity during sharp-wave ripples, underlying various cognitive functions.

NATURE NEUROSCIENCE (2021)

Article Neurosciences

Disengagement of Motor Cortex during Long-Term Learning Tracks the Performance Level of Learned Movements

Eun Jung Hwang, Jeffrey E. Dahlen, Madan Mukundan, Takaki Komiyama

Summary: It has been found that the dependence on the motor cortex during long-term learning is not fixed, but can dynamically change. Movements that achieve higher consistency are less dependent on the motor cortex, and superior motor performance can affect neural circuit reorganization.

JOURNAL OF NEUROSCIENCE (2021)

Article Engineering, Biomedical

Decoding of cortex-wide brain activity from local recordings of neural potentials

Xin Liu, Chi Ren, Zhisheng Huang, Madison Wilson, Jeong-Hoon Kim, Yichen Lu, Mehrdad Ramezani, Takaki Komiyama, Duygu Kuzum

Summary: The study demonstrates that locally recorded surface potentials contain rich information about large-scale neural activities, which can be decoded to recover neural activity across individual cortical regions. Including all frequency bands in the decoding model results in the highest decoding performance, and incorporating more recording channels improves the decoding performance even further. This cross-modality inference approach has the potential to reconstruct cortex-wide brain activity in a non-invasive manner and facilitate imaging neural activity in freely moving animals without the need for head-fixed microscopy configurations.

JOURNAL OF NEURAL ENGINEERING (2021)

Article Neurosciences

Context-dependent persistency as a coding mechanism for robust and widely distributed value

Ryoma Hattori, Takaki Komiyama

Summary: Task-related information is coded with different persistency across the brain. The coding persistency of action history and value in mice varies across areas, learning phases, and task context, with the highest persistency observed in the retrosplenial cortex of expert mice. Persistent coding enables robust signal coding and distribution in neuronal networks.

NEURON (2022)

Article Neurosciences

FARCI: Fast and Robust Connectome Inference

Saber Meamardoost, Mahasweta Bhattacharya, Eun Jung Hwang, Takaki Komiyama, Claudia Mewes, Linbing Wang, Ying Zhang, Rudiyanto Gunawan

Summary: The study developed a MATLAB package called FARCI for inferring neuronal connectomes from high-dimensional two-photon Calcium fluorescence data, using partial correlations as a measure of functional association strength between neuron pairs. Testing on simulated datasets demonstrated that FARCI provides accurate connectomes and is robust to network sizes, missing neurons, and noise levels. Compared to other algorithms, FARCI produces more accurate networks, with better computational speed and scalability.

BRAIN SCIENCES (2021)

Article Neurosciences

Learning binds new inputs into functional synaptic clusters via spinogenesis

Nathan G. Hedrick, Zhongmin Lu, Eric Bushong, Surbhi Singhi, Peter Nguyen, Yessenia Magana, Sayyed Jilani, Byung Kook Lim, Mark Ellisman, Takaki Komiyama

Summary: Learning induces the formation of new dendritic spines, which bind new presynaptic inputs into preexisting clusters, generating locally coherent inputs representing learned behaviors. Successful connections are selected based on co-activity with nearby task-related spines, ensuring the functional clustering of new spines. Furthermore, a majority of new spines synapse with previously unrepresented axons, suggesting the binding of new information into functional synaptic clusters.

NATURE NEUROSCIENCE (2022)

Article Neurosciences

Global and subtype-specific modulation of cortical inhibitory neurons regulated by acetylcholine during motor learning

Chi Ren, Kailong Peng, Ruize Yang, Weikang Liu, Chang Liu, Takaki Komiyama

Summary: This study found that different subtypes of inhibitory neurons (INs) in the cortex of mice learning a task are globally modulated throughout the cortex, with initial learning involving varying levels of activation of VIP-INs and SOM-INs. Furthermore, manipulation of the cholinergic system can affect the activity of cortical IN subtypes and subsequently impact motor learning.

NEURON (2022)

Article Engineering, Biomedical

Deep learning for neural decoding in motor cortex

Fangyu Liu, Saber Meamardoost, Rudiyanto Gunawan, Takaki Komiyama, Claudia Mewes, Ying Zhang, EunJung Hwang, Linbing Wang

Summary: In this study, deep learning was applied to neural decoding, and the performance of different decoding schemes was evaluated. The results showed that deep learning networks outperformed traditional machine learning algorithms in some decoding schemes, indicating the potential of deep learning for behavior decoding.

JOURNAL OF NEURAL ENGINEERING (2022)

Article Biochemical Research Methods

PatchWarp: Corrections of non-uniform image distortions in two-photon calcium imaging data by patchwork affine transformations

Ryoma Hattori, Takaki Komiyama

Summary: PatchWarp is a registration algorithm developed to correct slow image distortion in calcium imaging data. It combines rigid and non-rigid registrations to robustly correct non-uniform distortions and provides a fully automated method for registering images from different imaging sessions. PatchWarp improves the quality of neural activity analyses and is useful for correcting image distortions in a wide range of disciplines.

CELL REPORTS METHODS (2022)

Article Biochemical Research Methods

Longitudinal two-photon calcium imaging with ultra-large cranial window for head-fixed mice

Ryoma Hattori, Takaki Komiyama

Summary: This article describes a protocol for longitudinal in vivo two-photon calcium imaging using an ultra-large cranial window in head-fixed mice. The protocol allows tracking neural activity from different cortical areas at cellular resolution to understand cortical computations during behavioral tasks.

STAR PROTOCOLS (2022)

Article Biochemical Research Methods

Wide-field calcium imaging of cortex-wide activity in awake, head-fixed mice

Chi Ren, Takaki Komiyama

Summary: Characterizing cortex-wide neural activity through wide-field calcium imaging in awake, head-fixed mice allows for capturing large-scale neural activity with sufficient signal-to-noise ratio and spatiotemporal resolution. The use of genetically encoded calcium indicators enables longitudinal imaging and cell-type specificity. A processing pipeline for imaging data is also described.

STAR PROTOCOLS (2021)

No Data Available