Article
Neurosciences
Naomi L. Bean, Barry E. Stein, Benjamin A. Rowland
Summary: Hemianopia can be improved through noninvasive cross-modal stimulation, which is related to the ability of multisensory integration. However, multisensory integration is not a prerequisite for visual recovery in hemianopia.
Article
Behavioral Sciences
Ivan Camponogara
Summary: This brief review aims to summarize the most influential theories in multisensory integration and sensory-motor control and provide new ideas on the multisensory-motor integration process. The reviewer also proposes an alternative view of how the multisensory integration process unfolds along the action planning and execution and makes several connections with existing multisensory-motor control theories.
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS
(2023)
Article
Neurosciences
James K. Moran, Julian Keil, Alexander Masurovsky, Stefan Gutwinski, Christiane Montag, Daniel Senkowski
Summary: This study found that patients with schizophrenia showed reduced intersensory attention effects for unisensory stimuli compared to healthy controls, but not for bisensory stimuli. At the neural level, schizophrenia patients exhibited decreased intersensory attention effects for bisensory stimuli. However, there were no significant differences between schizophrenia patients and healthy controls in terms of multisensory integration.
Review
Behavioral Sciences
Jakub Limanowski
Summary: This paper evaluates how the flexibility of the brain's 'body model' is enhanced through 'top-down' sensory processing for adapting to novel visual feedback.
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS
(2022)
Article
Computer Science, Software Engineering
Hyeokmook Kang, Taeho Kang, Christian Wallraven
Summary: This study introduces a multimodal mixed-reality setup based on real-time hand-tracking to investigate multimodal conflict situations of objects varying along higher-level, parametrically-controlled global shape properties. The results demonstrate a clear touch dominance throughout all the experiments, indicating that touch prevails over vision in conflicts between the two modalities.
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
(2023)
Article
Neurosciences
Rodolfo Solis-Vivanco, Ole Jensen, Mathilde Bonnefond
Summary: The study found that in a bimodal attention task, the neuronal dynamics between the VAN and DAN mainly occur in the 12-20Hz frequency range, with the suppression of VAN aiding in better task performance. Furthermore, a power decrease and enhanced synchronization in both VAN and DAN were observed when multisensory integration enhanced attention involuntarily.
HUMAN BRAIN MAPPING
(2021)
Article
Behavioral Sciences
Ivan Camponogara, Robert Volcic
Summary: Research shows that haptic positional cues, combined with visual cues, are sufficient to achieve the same grasping performance as when all cues are available. These findings provide strong evidence that the human sensorimotor system relies on non-visual sensory inputs.
Article
Computer Science, Artificial Intelligence
Ting Yao, Yehao Li, Yingwei Pan, Yu Wang, Xiao-Ping Zhang, Tao Mei
Summary: Recent advances have proposed strategies to reduce the computational complexity of self-attention mechanism in high-resolution inputs. However, these approaches often fail to capture the holistic interactions among patches, limiting their ability to capture global semantics. In this paper, we introduce Dual Vision Transformer (Dual-ViT), a novel architecture that effectively utilizes global semantics for self-attention learning without compromising computational complexity. By integrating a semantic pathway and a pixel pathway, Dual-ViT is able to leverage global semantics to improve self-attention learning and achieve superior accuracy compared to state-of-the-art Transformer architectures.
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE
(2023)
Article
Neurosciences
Yunju Lee, Etem Curuk, Alexander S. Aruin
Summary: The study aimed to investigate the effects of light finger touch, cognitive tasks, and vision on postural sway in individuals with stroke. Results showed that postural sway increased without vision, decreased with finger touch, and increased with cognitive tasks. Additionally, performing finger touch and a cognitive task simultaneously led to decreased body sway compared to standing and performing a cognitive task alone.
JOURNAL OF MOTOR BEHAVIOR
(2021)
Article
Psychology, Experimental
Christopher W. Robinson, Jessica L. Parker
Summary: The study found that simple tones affect speeded visuomotor responses, with interference effects likely stemming from bottom-up factors and not being under attentional control. Explicit instructions to direct attention to the visual modality had little effect on eliminating auditory interference.
Article
Neurosciences
Natasha Ratcliffe, Katie Greenfield, Danielle Ropar, Ellen M. Howard, Roger Newport
Summary: The study found that older children are more influenced by visual information in incongruent conditions, leading to hand mislocalization. Compared to older children, younger children rely less on visual information in the hand localization task.
FRONTIERS IN HUMAN NEUROSCIENCE
(2021)
Article
Neurosciences
Naomi L. Bean, Scott A. Smyre, Barry E. Stein, Benjamin A. Rowland
Summary: The responses of individual superior colliculus (SC) neurons are enhanced by concordant visual-auditory stimuli. This ability for multisensory integration is acquired through cross-modal experience. Raising animals in omnidirectional sound prevents them from obtaining this experience and disrupts the normal multisensory transform in the SC, resulting in decreased responses to concordant visual-auditory stimuli. Behavioral experiments show that noise-reared animals do not exhibit multisensory performance benefits in simple detection/localization tasks, indicating a parallel between behavior and single neuron physiology.
Article
Neurosciences
Song Chang, Jinghong Xu, Mengyao Zheng, Les Keniston, Xiaoming Zhou, Jiping Zhang, Liping Yu
Summary: Increasing studies have shown that neural integration of multisensory cues can influence behavioral choices in sensory cortices. In this study, the researchers found that A1 neurons can enhance auditory responses to contralateral choices with task-irrelevant visual cues, facilitating sound discrimination.
JOURNAL OF NEUROSCIENCE
(2022)
Article
Neurosciences
Scott A. Smyre, Zhengyang Wang, Barry E. Stein, Benjamin A. Rowland
Summary: Neurons in the superior colliculus require cross-modal experience to develop their characteristic multisensory capability. Dysfunction in these neurons leads to impairments in behavioral capabilities such as detection and localization. Animals raised in darkness showed defects in multisensory detection and localization performance compared to normally reared animals.
EUROPEAN JOURNAL OF NEUROSCIENCE
(2021)
Article
Behavioral Sciences
Sonja Eckel, Martin Egelhaaf, Charlotte Doussot
Summary: In the search for their nest, bumblebees rely not only on visual cues, but also on natural scent marks to pinpoint potential locations. This finding highlights the crucial role of odor in helping bees find their way back to their nest.
FRONTIERS IN BEHAVIORAL NEUROSCIENCE
(2023)
Article
Neurosciences
Abdeldjallil Naceri, Alessandro Moscatelli, Robert Haschke, Helge Ritter, Marco Santello, Marc O. Ernst
JOURNAL OF NEUROPHYSIOLOGY
(2017)
Article
Biology
Irene Senna, Cesare V. Parise, Marc O. Ernst
PROCEEDINGS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES
(2017)
Article
Biochemical Research Methods
Cesare V. Parise, Marc O. Ernst
PLOS COMPUTATIONAL BIOLOGY
(2017)
Article
Multidisciplinary Sciences
Michael Barnett-Cowan, Marc O. Ernst, Heinrich H. Buelthoff
SCIENTIFIC REPORTS
(2018)
Article
Ophthalmology
Isabelle T. Garzorz, Tom C. A. Freeman, Marc O. Ernst, Paul R. MacNeilage
Article
Biochemical Research Methods
Marieke Rohde, Kenichi Narioka, Jochen J. Steil, Lina K. Klein, Marc O. Ernst
PLOS COMPUTATIONAL BIOLOGY
(2019)
Article
Neurosciences
Alessandro Moscatelli, Cecile R. Scotto, Marc O. Ernst
JOURNAL OF NEUROPHYSIOLOGY
(2019)
Article
Computer Science, Artificial Intelligence
Timo Oess, Maximilian P. R. Loehr, Daniel Schmid, Marc O. Ernst, Heiko Neumann
FRONTIERS IN NEUROROBOTICS
(2020)
Article
Multidisciplinary Sciences
Catharina Glowania, Myrthe A. Plaisier, Marc O. Ernst, Loes C. J. Van Dam
Article
Biochemical Research Methods
Timo Oess, Marc O. Ernst, Heiko Neumann
PLOS COMPUTATIONAL BIOLOGY
(2020)
Editorial Material
Neurosciences
Irene Senna, Luigi F. Cuturi, Monica Gori, Marc O. Ernst, Giulia Cappagli
FRONTIERS IN NEUROSCIENCE
(2021)
Article
Psychology, Experimental
Charlotte Roy, Dennis Wiebusch, Mario Botsch, Marc O. Ernst
Summary: Visual landmarks play a crucial role in human navigation, and a landmark should be distinctive, salient, precise, accurate, and permanent. Through experiments, it was found that humans can learn and update the statistics of landmark permanency, assigning more weight to the more permanent landmarks, making them more important for navigation.
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL
(2023)
Article
Computer Science, Cybernetics
Colleen P. Ryan, Simone Ciotti, Lucia Cosentino, Marc O. Ernst, Francesco Lacquaniti, Alessandro Moscatelli
Summary: Multiple cues contribute to the discrimination of slip motion speed by touch. Masking vibrations at high contact force significantly impair speed discrimination, while low contact force does not. Mechanical events at motion onset also provide important cues for speed discrimination.
IEEE TRANSACTIONS ON HAPTICS
(2022)
Article
Psychology, Multidisciplinary
Abdeldjallil Naceri, Yasemin B. Gultekin, Alessandro Moscatelli, Marc O. Ernst
Summary: This study investigated whether grasp force control is at the level of individual fingers or influenced by signals from other fingers of the same hand. The results showed that reducing tactile sensitivity increased overall grasping force and increased grasp force in the covered finger.
FRONTIERS IN PSYCHOLOGY
(2021)
Article
Robotics
Felix Huelsmann, Cornelia Frank, Irene Senna, Marc O. Ernst, Thomas Schack, Mario Botsch
FRONTIERS IN ROBOTICS AND AI
(2019)