Review
Neurosciences
Luxin Zhou, Yong Gu
Summary: Accurate self-motion perception is crucial for survival, and it involves multiple sensory cues such as optic flow and inertial motion. Recent studies challenge previous conventional thoughts about the cortical mechanisms underlying visuo-vestibular integration and propose that different temporal component signals may mediate different functions in multisensory self-motion perception.
NEUROSCIENCE BULLETIN
(2023)
Review
Behavioral Sciences
Anne-Laure Rineau, Lionel Bringoux, Jean-Christophe Sarrazin, Bruno Berberian
Summary: Self-motion perception is crucial for guiding pilots' behavior, and impairment in this perception can lead to spatial disorientation, a major cause of accidents. Visuo-vestibular integration is the main process underlying self-motion perception, and it can be modulated by the physical properties of the environment. Additionally, the internal state of an operator and the automation of systems can also influence self-motion perception.
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS
(2023)
Article
Multidisciplinary Sciences
Matthew O'Donohue, Philippe Lacherez, Naohide Yamamoto
Summary: When the brain is exposed to a temporal asynchrony between the senses, it will shift its perception of simultaneity towards the previously experienced asynchrony. Musical training can modulate audiovisual temporal recalibration, but does not affect the accuracy of sensory integration.
SCIENTIFIC REPORTS
(2022)
Article
Neurosciences
Luuk P. H. van de Rijt, A. John van Opstal, Marc M. van Wanrooij
Summary: Our study demonstrates that in divided-attention tasks, unisensory speech listening and reading are negatively impacted for CI users, while this effect does not apply to normal-hearing individuals.
FRONTIERS IN NEUROSCIENCE
(2021)
Article
Neurosciences
Cecile R. Scotto, Alessandro Moscatelli, Thies Pfeiffer, Marc O. Ernst
Summary: The study demonstrates that smooth pursuit eye movements can bias tactile motion perception. This bias is influenced by the reliability of tactile estimates and the presence of visual background, supporting the Bayesian framework of motion perception. Overall, the results suggest shared representations for motion perception across different sensory modalities.
JOURNAL OF NEUROPHYSIOLOGY
(2021)
Article
Psychology, Multidisciplinary
Anne-Laure Rineau, Bruno Berberian, Jean-Christophe Sarrazin, Lionel Bringoux
Summary: Self-motion perception is influenced by visuo-vestibular integration and the reliability of sensory inputs. This study found that being in control of our own action through manual triggers can enhance motion sensitivity, even when the level of ambiguity increases. The results highlight the importance of considering the internal state and agency in self-motion perception.
FRONTIERS IN PSYCHOLOGY
(2023)
Article
Biology
Irene Togoli, Michele Fornaciai, Domenica Bueti
Summary: Magnitude information is crucial for interacting with the external environment, and the integration between numerosity and duration depends on the stimuli used and the neural processing dynamics.
PROCEEDINGS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES
(2021)
Article
Clinical Neurology
Marcel Schulze, Behrem Aslan, Paul Jung, Silke Lux, Alexandra Philipsen
Summary: This study investigated the robustness of bottom-up multisensory integration (MI) in ADHD patients under high perceptual load. The results showed that ADHD patients had similar performance in MI compared to healthy controls, regardless of perceptual load manipulation. However, sensory accumulation may be altered when attentional demands are high.
EUROPEAN ARCHIVES OF PSYCHIATRY AND CLINICAL NEUROSCIENCE
(2022)
Article
Psychology
Sara Fiscella, Madeline S. Cappelloni, Ross K. Maddox
Summary: It is well established that listeners use both facial and auditory information to comprehend speech in noisy environments. This study investigated how listeners use audiovisual speech correspondences along the multisensory speech processing pathway. The results showed that temporal coherence supports early integration, but binding is minimally affected by face rotation.
ATTENTION PERCEPTION & PSYCHOPHYSICS
(2022)
Article
Neurosciences
Sinem Balta Beylergil, Palak Gupta, Aasef G. Shaikh
Summary: Multisensory integration is crucial for accurate perception of heading direction, but deficiency in cerebellar function can lead to impaired integration and inaccurate heading perception. Oculopalatal tremor patients show poorer heading direction perception compared to healthy controls, possibly due to abnormal noise in the cerebellar system caused by hypersynchronized inferior olive signals.
Article
Neurosciences
I. Arshad, M. Gallagher, E. R. Ferre
Summary: Conflicts in visuo-vestibular signalling can affect sensitivity to multisensory percepts, particularly verticality. This suggests that conflicts not only modulate processing in unimodal channels, but also impact broader multisensory percepts.
NEUROSCIENCE LETTERS
(2023)
Article
Multidisciplinary Sciences
Meenakshi Khosla, Gia H. Ngo, Keith Jamison, Amy Kuceyeski, Mert R. Sabuncu
Summary: The study demonstrates that group-level models of neural activity built using movie-watching data can achieve remarkable prediction performance across large areas of the cortex, even beyond sensory-specific areas. These encoding models not only learn high-level concepts that generalize to task-bound paradigms, but also show great potential as powerful tools for studying brain function.
Article
Neurosciences
Hiroshi Yoshimatsu, Yuko Yotsumoto
Summary: This study investigated the effect of attention on duration integration of visual and auditory stimuli, finding that the perceived duration depends on which modality participants attend to. Using Bayesian hierarchical modeling, the research concluded that attention affects duration integration by changing the weighted average of each sensory modality. Furthermore, considering stimulus reliability, the study suggests that the increase of weight by attention impacts duration integration even after controlling for stimulus reliability.
FRONTIERS IN HUMAN NEUROSCIENCE
(2021)
Article
Neurosciences
Jiaqiu Sun, Ziqing Wang, Xing Tian
Summary: This study investigates how motional gestures can modulate loudness perception, showing that gestural information biases judgment of loudness and modulates early auditory responses. This suggests that visual-motor processing integrates with auditory processing at an early perceptual stage to shape the perception of low-level attributes like loudness.
FRONTIERS IN NEUROSCIENCE
(2021)
Article
Multidisciplinary Sciences
Sophia Piller, Irene Senna, Marc O. O. Ernst
Summary: The Bouba-Kiki effect is the systematic mapping between round/spiky shapes and speech sounds. In the size-weight illusion, participants judge the smaller of two equally-weighted objects as being heavier. This study examined the contribution of visual experience to the development of these phenomena by comparing three groups: early blind individuals, individuals treated for congenital cataracts, and typically sighted controls. The findings suggest that visual experience plays a pivotal role in these phenomena and that a short period of visual experience, even gained later in life, is sufficient for participants to pick up regularities in the environment and contribute to the development of these effects.
SCIENTIFIC REPORTS
(2023)
Article
Computer Science, Artificial Intelligence
Thomas Nestmeyer, Paolo Robuffo Giordano, Heinrich H. Buelthoff, Antonio Franchi
Article
Computer Science, Artificial Intelligence
Ayoung Hong, Dong Gun Lee, Heinrich H. Buelthoff, Hyoung Il Son
JOURNAL ON MULTIMODAL USER INTERFACES
(2017)
Article
Psychology
Aurelie Saulton, Heinrich H. Buelthoff, Stephan de la Rosa
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE
(2017)
Article
Automation & Control Systems
Joost Venrooij, Max Mulder, Mark Mulder, David A. Abbink, Marinus M. van Paassen, Frans C. T. van der Helm, Heinrich H. Buelthoff
IEEE TRANSACTIONS ON CYBERNETICS
(2017)
Article
Automation & Control Systems
Frank M. Drop, Daan M. Pool, Marinus (Rene) M. van Paassen, Max Mulder, Heinrich H. Buelthoff
IEEE TRANSACTIONS ON CYBERNETICS
(2018)
Article
Multidisciplinary Sciences
Alessandro Nesti, Ksander de Winkel, Heinrich H. Buelthoff
Article
Multidisciplinary Sciences
Ksander N. de Winkel, Mikhail Katliar, Heinrich H. Buelthoff
Article
Multidisciplinary Sciences
Suzanne A. E. Nooij, Paolo Pretto, Daniel Oberfeld, Heiko Hecht, Heinrich H. Buelthoff
Article
Multidisciplinary Sciences
Ksander N. de Winkel, Mikhail Katliar, Daniel Diers, Heinrich H. Buelthoff
SCIENTIFIC REPORTS
(2018)
Article
Multidisciplinary Sciences
Michael Barnett-Cowan, Marc O. Ernst, Heinrich H. Buelthoff
SCIENTIFIC REPORTS
(2018)
Article
Multidisciplinary Sciences
Junsuk Kim, Isabelle Buelthoff, Sung-Phil Kim, Heinrich H. Buelthoff
SCIENTIFIC REPORTS
(2019)
Article
Neurosciences
Ksander N. de Winkel, Florian Soyka, Heinrich H. Buelthoff
EXPERIMENTAL BRAIN RESEARCH
(2020)
Article
Neurosciences
Tugrul Irmak, Ksander N. de Winkel, Daan M. Pool, Heinrich H. Bulthoff, Riender Happee
Summary: The study found a relationship between individual motion perception characteristics and motion sickness sensitivity, with considerable variability in frequency sensitivities among individuals. While no significant group-level effect of frequency on motion sickness was observed, a strong positive correlation was found between the subjective vertical time constant and general motion sickness sensitivity at the individual level.
EXPERIMENTAL BRAIN RESEARCH
(2021)
Article
Robotics
Rahul Tallamraju, Eric Price, Roman Ludwig, Kamalakar Karlapalem, Heinrich H. Buelthoff, Michael J. Black, Aamir Ahmad
IEEE ROBOTICS AND AUTOMATION LETTERS
(2019)
Proceedings Paper
Computer Science, Artificial Intelligence
Nina Flad, Tatiana Fomina, Heinrich H. Buelthoff, Lewis L. Chuang
EYE TRACKING AND VISUALIZATION: FOUNDATIONS, TECHNIQUES, AND APPLICATIONS, ETVIS 2015
(2017)