Article
Neurosciences
Canhuang Luo, Sasskia Bruers, Isabelle Berry, Rufin VanRullen, Leila Reddy
Summary: The study investigates how visual information reverberates in the human brain in the form of perceptual echoes through a combination of EEG and fMRI recordings. The findings suggest that these echoes likely originate in early visual cortex, influenced by widespread activity in V1 and V2.
Article
Engineering, Electrical & Electronic
Chenglizhao Chen, Mengke Song, Wenfeng Song, Li Guo, Muwei Jian
Summary: Video saliency detection aims to locate the most attractive objects/patterns in a given video clip. Existing works have focused more on the visual system and ignored the audio aspect. This paper provides a comprehensive review to bridge the gap between audio-visual fusion and saliency detection.
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY
(2023)
Article
Computer Science, Information Systems
Yee-Pay Wuang, Yenming J. Chen, Yu-Hsien Chiu, Chih-Chung Wang, Chiu-Ping Chen, Chien-Ling Huang, Tang-Meng Wu, Tsung-Han Hsieh, Wen-Hsien Ho
Summary: The study demonstrated that augmented reality technology for visual perceptual rehabilitation in children with developmental delays can significantly improve visual-motor integration and overall visual perceptual functions.
Article
Behavioral Sciences
Samra Alispahic, Elizabeth Pellicano, Anne Cutler, Mark Antoniou
Summary: This study explored the perceptual learning effects in Australian English autistic and non-autistic adults using a lexically-guided perceptual learning paradigm. It revealed that autistic adults did not show the same automatic attunement to existing phoneme categories as non-autistic individuals when exposed to a novel talker. This finding has implications for speech and language processing by autistic individuals and current sensory theories.
Article
Computer Science, Information Systems
Yun Liu, Xiaohua Yin, Zuliang Wan, Guanghui Yue, Zhi Zheng
Summary: Compared to ordinary images, omnidirectional image (OI) usually provides a wider view and higher resolution. Image quality assessment (IQA) is important for understanding and improving visual experience. However, current IQA methods have limitations. Therefore, we propose a novel NR/B-OIQA model based on visual perception to address these issues. Our model combines global structural features and local structural features to capture quality-aware information, considers color information using a steganalysis real model-based color descriptor, and quantifies the unnaturalness of omnidirectional images using image entropy and natural scene statistics features. Experimental results demonstrate that our model outperforms other methods and is more consistent with subjective values.
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS
(2023)
Article
Neurosciences
Liliana Albertazzi, Luisa Canal, Rocco Micciolo, Iacopo Hachen
Summary: The study verified that thickness and type variables are more important in line categorization, while color variables are generally less significant, and orientation variables are generally insignificant. These results emphasize the relevance of characteristics such as thickness and type in line perception.
Article
Psychology, Multidisciplinary
Hanin Karah, Hanin Karawani
Summary: This study evaluates a home-based auditory exercises program that can be used during the adaptation process for hearing aid use in older adults. The findings suggest that hearing aid users, including new users, demonstrated better perceptual performance compared to their peers who did not use hearing aids, particularly in speech perception tasks in noise.
FRONTIERS IN PSYCHOLOGY
(2022)
Article
Ophthalmology
Bao N. Nguyen, Bhavatharini Ramakrishnan, Anuradha Narayanan, Jameel R. Hussaindeen, Allison M. McKendrick
Summary: This study found that early adolescents show weaker center-surround contrast suppression compared to adults.
INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE
(2023)
Article
Neuroimaging
Jan-Ole Radecke, Irina Schierholz, Andrej Kral, Thomas Lenarz, Micah M. Murray, Pascale Sandmann
Summary: This study investigates the perception of auditory and audio-visual stimuli in patients with cochlear implants (CI). The results show that, similar to normal-hearing listeners, CI users also benefit from audio-visual perception in auditory-only conditions. The analyses of event-related potentials (ERPs) reveal distinct cortical processing patterns in CI users compared to normal-hearing listeners when processing congruent audio-visual stimuli.
NEUROIMAGE-CLINICAL
(2022)
Article
Psychiatry
Ragy R. Girgis, Xinyang Feng, Gary Brucato, Hannah C. Sigmon, Jeffrey A. Lieberman, Frank Provenzano
Summary: This study aimed to examine the neurobiology of auditory and visual perceptual abnormalities in CHR individuals using MRI. Results showed a positive relationship between severity of visual perceptual abnormalities and brain volumes in specific regions, while no such relationship was observed for auditory perceptual abnormalities. This suggests that while perceptual abnormalities may have common neurobiological mechanisms, different types may also have distinct pathogeneses.
JOURNAL OF PSYCHIATRIC RESEARCH
(2021)
Article
Psychology, Multidisciplinary
Julia Merrill
Summary: Understanding voice usage is crucial for understanding human interaction. However, research on auditory perceptual evaluation of voices has mainly focused on voice professionals, neglecting how untrained listeners perceive and describe voices. This study found that untrained listeners were able to describe voices using vocal characteristics related to sound quality, pitch changes, articulation, and variability in expression. Language and expertise did not affect the assessment of singers, and roughness and tension were important features for voice discrimination.
CURRENT PSYCHOLOGY
(2023)
Article
Computer Science, Software Engineering
Kushin Mukherjee, Brian Yin, Brianne E. Sherman, Laurent Lessard, Karen B. Schloss
Summary: People's associations between colors and concepts influence their ability to interpret color meanings. Even if a concept is not strongly associated with any colors, it can be disambiguated through comparison with other concepts. The semantic discriminability theory explains how people infer meaning from visual features and suggests that the capacity for semantic discriminability is limited by the difference in color-concept associations. Two experiments supported this theory, showing that the ability to produce semantically discriminable colors is constrained by statistical distance, and colors can communicate meaning even for concepts previously considered non-colorable. These results emphasize the importance of colors in visual communication.
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
(2022)
Article
Chemistry, Multidisciplinary
Alice Cancer, Marinella De Salvatore, Elisa Granocchio, Luca Andreoli, Alessandro Antonietti, Daniela Sarti
Summary: A computerized rhythmic intervention called Rhythmic Reading Training (RRT) was developed to improve the reading skills of children with dyslexia. An experimental study was conducted to assess the contribution of the visual component in the training. The results showed that both auditory and visual conditions of RRT significantly improved reading, phonological, rhythmic, and attentional abilities, with no additional contribution from the visual component.
APPLIED SCIENCES-BASEL
(2022)
Article
Psychology, Multidisciplinary
Nathan C. Higgins, Ambar G. Monjaras, Breanne D. Yerkes, David F. Little, Jessica E. Nave-Blodgett, Mounya Elhilali, Joel S. Snyder
Summary: The study indicates that modality-specific processing is crucial for controlling conscious perception, with distractors affecting the probability of perceptual switching. The fact that distractors did not overlap with bistable stimuli indicates that perceptual reset may be due to interference at a locus where stimuli of different frequencies and spatial locations are integrated.
FRONTIERS IN PSYCHOLOGY
(2021)
Article
Neurosciences
Henning Tiedemann, Filipp Schmidt, Roland W. Fleming
Summary: This study investigates the role of limb organization in differentiating animals from plants. The researchers find several distinctive growth characteristics that affect the spatial arrangement and properties of limbs, providing useful cues for categorization. By generating novel object pairs with different part structures, they show that particular part organizations can make stimuli look more like plants or animals. The study suggests that subtle changes in part properties and organization can provide powerful cues for superordinate categorization.
Article
Neurosciences
Andrea Alamia, Canhuang Luo, Matthew Ricci, Junkyung Kim, Thomas Serre, Rufin VanRullen
Summary: The development of deep convolutional neural networks has brought success in computer vision, but also revealed limitations beyond image categorization tasks. Research shows differences in cortical mechanisms between humans and artificial neural networks when identifying whether two simultaneously presented items are the same or different.
Article
Multidisciplinary Sciences
Leila Reddy, Matthew W. Self, Benedikt Zoefel, Marlene Poncet, Jessy K. Possel, Judith C. Peters, Johannes C. Baayen, Sander Idema, Rufin VanRullen, Pieter R. Roelfsema
Summary: Research in the human temporal lobe shows that the timing of neuronal activity relative to theta brain oscillation reflects sequence order. The study found that spikes in three consecutive items in a sequence were phase-locked at distinct phases of the theta oscillation, with spikes being fired at progressively earlier phases as the sequence advanced.
NATURE COMMUNICATIONS
(2021)
Article
Neurosciences
Canhuang Luo, Wei Chen, Rufin VanRullen, Ye Zhang, Carl Michael Gaspar
Summary: This study investigated the impact of inter-stimulus interval (ISI) on the relationship between the N170 and recognition potential (RP), revealing reverse relationships between ISI and N170 latency, N1 jitter, and reaction time. The unique scalp topographies at the N1 peak across different conditions, from the longest ISI (N170) to the shortest (RP), suggest that the mask-delayed N1 remains the same N170. The results indicate a greater synthesis in the study of event related potential components.
HUMAN BRAIN MAPPING
(2022)
Article
Computer Science, Artificial Intelligence
Zhaoyang Pang, Callum Biggs O'May, Bhavin Choksi, Rufin VanRullen
Summary: The study shows that incorporating brain-inspired feedback dynamics into convolutional neural networks can improve the perception of illusory contours. This is achieved through pretraining the model on natural image datasets and feedback error correction.
Editorial Material
Psychology, Biological
Rufin VanRullen
Summary: This report describes the emergence of human-like auditory perception in deep neural networks and suggests a promising way to relate perceptual behavior to specific aspects of the environment.
NATURE HUMAN BEHAVIOUR
(2022)
Article
Computer Science, Artificial Intelligence
Mohit Vaishnav, Remi Cadene, Andrea Alamia, Drew Linsley, Rufin VanRullen, Thomas Serre
Summary: This article investigates the computational demands for abstract visual reasoning, characterizing the taxonomy of visual reasoning tasks based on relation types and number of relations used. The study also finds that attention plays a key role in visual reasoning, with attention networks improving performance on the hardest reasoning tasks. The work provides a granular computational account of visual reasoning and offers testable neuroscience predictions regarding the need for different types of attention.
NEURAL COMPUTATION
(2022)
Article
Multidisciplinary Sciences
Garance Merholz, Laetitia Grabot, Rufin VanRullen, Laura Dugue
Summary: Attention periodically samples visual information, supported by brain oscillations. Differences in attentional demands due to task heterogeneity contribute to the discrepancy in periodic frequencies observed in the literature. This study used visual search to test this hypothesis and found that task complexity influenced search performance and EEG activity.
SCIENTIFIC REPORTS
(2022)
Article
Computer Science, Artificial Intelligence
Bhavin Choksi, Milad Mozafari, Rufin VanRullen, Leila Reddy
Summary: The human hippocampus possesses concept cells that respond to specific stimuli. Similar concept cells were recently discovered in a multimodal network called CLIP, raising the question of whether CLIP can better explain the fMRI activity of the human hippocampus.
Article
Computer Science, Artificial Intelligence
Andrea Alamia, Milad Mozafari, Bhavin Choksi, Rufin VanRullen
Summary: This study investigates the functional role of top-down feedback connections in object recognition under noisy conditions by implementing predictive coding dynamics in convolutional neural networks. The results show that the accuracy of the network is significantly improved, and the network increasingly relies on top-down predictions as the noise level increases.
Article
Neurosciences
Samson Chota, Rufin VanRullen, Rasa Gulbinaite
Summary: Both passive tactile stimulation and motor actions result in dynamic changes in beta band oscillations over somatosensory cortex. Contrary to previous findings, white noise stimulation actually causes an initial increase in beta activity, followed by bursts that last for 3 cycles. These bursts share characteristics with evoked and resting-state oscillations and are determined by the resonance properties of the somatosensory system.
JOURNAL OF NEUROSCIENCE
(2023)
Article
Biology
Andrea Alamia, Lucie Terral, Malo Renaud D'ambra, Rufin VanRullen, Jonas Obleser
Summary: Previous research has linked alpha-band oscillations with inhibitory functions, but contradictory findings suggest different underlying processes. Using traveling wave analysis, the present study reveals two distinct alpha-band oscillations propagating in opposite directions. These findings highlight the importance of considering oscillations as traveling waves when studying their functional role.
Article
Neurosciences
Salim Yalcin Inan, Sendegul Yildirim, Gamze Tanriover, Barkin Ilhan
Summary: This study investigated the potential role of omega-Agatoxin IVA, a specific Cav2.1 blocker, in suppressing epileptogenesis. The results showed that omega-Agatoxin IVA significantly prolonged the onset of seizures and suppressed the development of kindling and epileptic discharges. Furthermore, it increased the expression of BDNF and decreased the expression of cleaved caspase-3 in the brain.
MOLECULAR NEUROBIOLOGY
(2023)
Proceedings Paper
Computer Science, Artificial Intelligence
Furkan Ozcelik, Bhavin Choksi, Milad Mozafari, Leila Reddy, Rufin VanRullen
Summary: This study successfully reconstructed natural images from fMRI signals using an Instance-Conditioned GAN model, preserving accurate semantic attributes and low-level details. By predicting and applying instance features and noise vectors, the generated images showed state-of-the-art results in capturing the semantic attributes of the original images.
2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN)
(2022)
Proceedings Paper
Automation & Control Systems
Colin Decourt, Rufin VanRullen, Didier Salle, Thomas Oberlin
Summary: Due to the limited raw data and low resolution of automotive radar, research on deep learning models for automotive radar object detection has been limited compared to camera and lidar-based approaches. However, radars are low-cost sensors that can accurately detect object characteristics regardless of weather conditions. Recent open-source datasets have facilitated research in various aspects such as object classification and detection. This paper presents DAROD, an adaptation of Faster R-CNN for automotive radar, achieving better performance on CARRADA and RADDet datasets compared to competing methods.
2022 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV)
(2022)
Article
Psychology, Biological
Canhuang Luo, Rufin VanRullen, Andrea Alamia
Summary: Recent studies have shown that Alpha rhythms in the human brain are directly related to visual stimulation, giving rise to perceptual echoes (PE) which are associated with conscious perception. The alpha power of PE generated by consciously perceived stimuli is comparable to monocular vision and higher than that of suppressed stimuli, indicating a correlation between neural synchronization and conscious perception in visual sampling.
NEUROSCIENCE OF CONSCIOUSNESS
(2021)
