Article
Multidisciplinary Sciences
Benjamin Cellini, Wael Salem, Jean-Michel Mongeau
Summary: The study shows that fruit flies' body movements are sensitive to the speed of visual motion, while head movements are sensitive to acceleration, enabling them to stabilize a broader range of visual motion frequencies. Fruit flies implement proportional-derivative (PD) control by relaying proportional and derivative signals in parallel to two distinct motor outputs.
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
(2022)
Article
Computer Science, Artificial Intelligence
Primesh Pathirana, Shashimal Senarath, Dulani Meedeniya, Sampath Jayarathna
Summary: This paper presents a comprehensive survey of single-user and multi-user gaze estimation approaches with deep learning. State-of-the-art methods are analyzed, and the limitations, challenges, and future directions of multi-user gaze estimation are discussed.
EXPERT SYSTEMS WITH APPLICATIONS
(2022)
Article
Psychology, Mathematical
Niilo V. Valtakari, Roy S. Hessels, Diederick C. Niehorster, Charlotte Viktorsson, Par Nystroem, Terje Falck-Ytter, Chantal Kemner, Ignace T. C. Hooge
Summary: Computer-vision-based gaze estimation techniques directly estimate gaze direction from video recordings without the need for an eye tracker. This study aimed to identify usable methods for average researchers in fields like psychology or education and evaluated two toolkits, OpenFace and OpenGaze. OpenGaze was found to be accurate and precise enough for screen-based experiments, while OpenFace showed potential in sparse environments. However, OpenFace should not be used for drawing conclusions on measures like dwell duration.
BEHAVIOR RESEARCH METHODS
(2023)
Review
Neurosciences
Maria Pia Bucci, Philippe Villeneuve
Summary: This article reviews recent studies on postural control, specifically focusing on the role of foot and visual inputs in a static postural stance. The authors performed a search and synthesis of articles from electronic databases such as Scopus, Web of Science, EBSCO, PubMed, and ResearchGate published until 2021. The aim of this review is to provide reference values for future studies on postural control in both healthy individuals and patients, and to encourage the development of protocols that consider the specificity of different systems responsible for human balance control.
Article
Chemistry, Analytical
Michael Barz, Daniel Sonntag
Summary: The research focuses on automatically detecting visual attention to AOIs using pre-trained deep learning models for image classification and object detection. An evaluation framework based on the VISUS dataset and well-known performance metrics from the field of activity recognition was developed. The methods were systematically evaluated within this framework, discussing potentials and limitations, and proposing ways to improve the performance of future automatic visual attention detection methods.
Article
Physiology
Alice Goerger, Anne-Sophie Darmaillacq, Nadav Shashar, Ludovic Dickel
Summary: This study investigated the impact of rearing cuttlefish under different turbidity conditions on their visual development. The results suggest that exposure to turbid water improves the development of polarization sensitivity in cuttlefish, especially when tested in clear water.
FRONTIERS IN PHYSIOLOGY
(2021)
Article
Computer Science, Information Systems
Agapito Ledezma, Victor Zamora, Oscar Sipele, M. Paz Sesmero, Araceli Sanchis
Summary: Car accidents are a leading cause of death, often caused by driver distractions. Advanced Driver Assistance Systems (ADAS) aim to improve road safety by warning drivers of dangerous situations, but continuous alarms can be overwhelming. This study proposes using gaze tracking to build an efficient ADAS that alerts drivers only when distracted, achieving promising results in a driving simulation environment with hit ratios between 96.37% and 81.84%.
Article
Multidisciplinary Sciences
Ehud Zohary, Daniel Harari, Shimon Ullman, Itay Ben-Zion, Ravid Doron, Sara Attias, Yuval Porat, Asael Y. Sklar, Ayelet Mckyton
Summary: Understanding others' intentions requires understanding their gaze. Infants naturally acquire this ability, but can it be learned later if vision is extremely poor in early childhood? A study on Ethiopian patients with congenital cataracts showed that even after sight restoration surgery, they still could not exhibit normal eye gaze-following behavior.
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
(2022)
Article
Computer Science, Interdisciplinary Applications
Hongmei Liu, Huabiao Qin
Summary: This paper proposes a localization method based on depth perception to address spatial judgment errors in virtual space, using binocular gaze tracking to measure perceived depth, comparing eye matrix and camera matrix to calculate actual depth, and adjusting virtual camera position to make users feel consistent distance between virtual and real spaces.
Review
Robotics
Hang Yin, Anastasia Varava, Danica Kragic
Summary: The importance of perceiving and handling deformable objects in our daily life is highlighted in this paper, with a focus on automating tasks like food handling and garment sorting. Advances in data-driven approaches, combined with traditional control and planning methods, offer viable solutions to these challenges. A learning perspective is utilized to unify discussions on analytical and data-driven methods, addressing the integration of model priors and task data in manipulating deformable objects.
Article
Computer Science, Artificial Intelligence
Akshay Rangesh, Bowen Zhang, Mohan Manubhai Trivedi
Summary: This study proposes solutions to address challenges faced by drivers, such as illumination and eyeglasses. By using infrared cameras and image-to-image translation methods, the gaze direction of drivers can be accurately estimated, improving performance and robustness.
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES
(2022)
Article
Computer Science, Cybernetics
Lida Huang, Thomas Westin, Mirjam Palosaari Eladhar, Sindri Magnusson, Hao Chen
Summary: EyeCompass is a system that enables high-fidelity and efficient free-eye drawing through unimodal gaze control. By addressing the challenges of gaze-control drawing, it provides value to people with motor disabilities. The system utilizes brush damping dynamics and the gaze-oriented method as initial mechanisms to improve the drawing performance, as demonstrated in user experiments and a field study.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2023)
Article
Ophthalmology
Teresa Zwierko, Beatriz Redondo, Wojciech Jedziniak, Ruben Molina, Raimundo Jimenez, Jesus Vera
Summary: This study aimed to measure how alterations in binocular vision integrity impact gaze behaviour during complex psychomotor skills. Participants completed a multiple object tracking task under different visual conditions. The results showed that altering visual conditions significantly affected the performance of the task and gaze parameters such as fixation duration, saccade duration, and blink rate.
OPHTHALMIC AND PHYSIOLOGICAL OPTICS
(2023)
Article
Neurosciences
M. S. Breu, H. Ramezanpour, P. W. Dicke, P. Thier
Summary: Gaze following is a crucial aspect of non-verbal communication and plays a significant role in successful social interactions. This study utilized event-related fMRI to investigate the neural mechanisms underlying the cognitive control of gaze following. The findings suggest that overactivation of frontoparietal circuits might contribute to deficits in gaze following observed in clinical populations.
EUROPEAN JOURNAL OF NEUROSCIENCE
(2023)
Article
Computer Science, Information Systems
Ahmed Nizar Alshakhs, Muhammad Faizan Mysorewala, Abdul-Wahid A. Saif, Khaled Alshehri
Summary: This study proposes an algebraic method that utilizes the cascading structure of the neck and eye to solve the multi-solution and inverse kinematics problems. A sliding mode controller is designed to move the neck-eye joints to their desired positions. Simulation results in the MATLAB/SIMULINK environment show that the system can effectively gaze at different stationary and moving targets, exhibiting human-like gaze behavior.
Article
Biology
Jean-Michel Mongeau, Karen Y. Cheng, Jacob Aptekar, Mark A. Frye
JOURNAL OF EXPERIMENTAL BIOLOGY
(2019)
Article
Biology
Mehmet F. Keles, Jean-Michel Mongeau, Mark A. Frye
JOURNAL OF EXPERIMENTAL BIOLOGY
(2019)
Article
Neurosciences
Orkun Akin, Bryce T. Bajar, Mehmet F. Keles, Mark A. Frye, S. Lawrence Zipursky
Article
Biochemistry & Molecular Biology
Karen Y. Cheng, Rachel A. Colbath, Mark A. Frye
Editorial Material
Biochemistry & Molecular Biology
Carola Stadele, Martha Rimniceanu, Mark A. Frye
Review
Behavioral Sciences
Karen Y. Cheng, Mark A. Frye
JOURNAL OF COMPARATIVE PHYSIOLOGY A-NEUROETHOLOGY SENSORY NEURAL AND BEHAVIORAL PHYSIOLOGY
(2020)
Article
Cell Biology
Mehmet F. Keles, Ben J. Hardcastle, Carola Stadele, Qi Xiao, Mark A. Frye
Article
Biochemistry & Molecular Biology
Carola Stadele, Mehmet F. Keles, Jean-Michel Mongeau, Mark A. Frye
Article
Biology
Wael Salem, Benjamin Cellini, Mark A. Frye, Jean-Michel Mongeau
JOURNAL OF EXPERIMENTAL BIOLOGY
(2020)
Article
Genetics & Heredity
Maureen M. Sampson, Katherine M. Myers Gschweng, Ben J. Hardcastle, Shivan L. Bonanno, Tyler R. Sizemore, Rebecca C. Arnold, Fuying Gao, Andrew M. Dacks, Mark A. Frye, David E. Krantz
Article
Biology
Ben J. Hardcastle, Jaison J. Omoto, Pratyush Kandimalla, Bao-Chau M. Nguyen, Mehmet F. Keles, Natalie K. Boyd, Volker Hartenstein, Mark A. Frye
Summary: The study characterizes neural circuitry in the fruit fly which conveys polarized light signals from the eye to the central complex, similar to other insects' 'sky compass' pathways. It reveals how neural tunings in the peripheral visual system are transformed into a reduced representation suited to flexible processing in the central brain. This study provides insights into computational motifs of multisensory integration and central processing for navigation in the brains of insects.
Article
Biology
Giovanni Frighetto, Mark A. Frye
Summary: Drosophila uses smooth optomotor movements to stabilize gaze and impulsive saccades to pursue vertical bars, with T4 and T5 cells providing inputs for gaze stabilization and T3 cells driving bar tracking body saccades. Silencing T3 reduces tracking saccades, while optogenetic manipulation affects saccade rate. Smooth optomotor responses remain unaffected. Parallel neural pathways coordinate gaze stabilization and saccadic bar tracking behavior in flight.
Article
Biochemistry & Molecular Biology
Jean-Michel Mongeau, Mark A. Frye
Article
Biochemistry & Molecular Biology
Jaison Jiro Omoto, Mehmet Fatih Keles, Bao-Chau Minh Nguyen, Cheyenne Bolanos, Jennifer Kelly Lovick, Mark Arthur Frye, Volker Hartenstein
Article
Biochemistry & Molecular Biology
Mehmet F. Keles, Mark A. Frye