Article
Surgery
Fabio Cofano, Giuseppe Di Perna, Marco Bozzaro, Alessandro Longo, Nicola Marengo, Francesco Zenga, Nicola Zullo, Matteo Cavalieri, Luca Damiani, Daniya J. Boges, Marco Agus, Diego Garbossa, Corrado Cali
Summary: This study successfully utilized augmented reality technology in spine surgery, achieving positive outcomes such as remote guidance, teaching, and surgical planning superimposition, improving convenience and efficiency in surgeries.
FRONTIERS IN SURGERY
(2021)
Article
Optics
Yunho Shin, Yingfei Jiang, Qian Wang, Ziyuan Zhou, Guangkui Qin, Deng-Ke Yang
Summary: This article reports a light waveguide liquid crystal display (LCD) based on the flexoelectric effect. The display exhibits different levels of transparency in the on and off states and is suitable for transparent display applications.
PHOTONICS RESEARCH
(2022)
Review
Health Care Sciences & Services
Alana Dinh, Andrew Lukas Yin, Deborah Estrin, Peter Greenwald, Alexander Fortenko
Summary: This review summarizes the implementation of augmented reality (AR) in remote medical care and education, highlighting its potential to enhance information access and guidance. It identifies the current gaps in research and emphasizes the need for further investigation and validation of AR as an alternative to telecommunication platforms and in-person interactions.
JMIR MHEALTH AND UHEALTH
(2023)
Article
Multidisciplinary Sciences
Dongjin Kim, Baekgyeom Kim, Bongsu Shin, Dongwook Shin, Chang-Kun Lee, Jae-Seung Chung, Juwon Seo, Yun-Tae Kim, Geeyoung Sung, Wontaek Seo, Sunil Kim, Sunghoon Hong, Sungwoo Hwang, Seungyong Han, Daeshik Kang, Hong-Seok Lee, Je-Sung Koh
Summary: This study demonstrates augmented reality glasses and haptic gloves enabled by artificial muscle actuators, which allow for image depth control and immersive tactile response. These lightweight and high-power actuators solve engineering problems in compact wearable devices.
NATURE COMMUNICATIONS
(2022)
Correction
Optics
Qiang Li, Wei He, Huan Deng, Fei-Yan Zhong, Yue Chen
Summary: In the published article of 2021, the title of the second part has been corrected according to the OSA Open Access Publishing Agreement by the Optical Society of America.
Article
Multidisciplinary Sciences
Alejandro Velez-Zea, John Fredy Barrera-Ramirez
Summary: This study presents a full-color near-eye holographic display that can overlay color virtual scenes with different dimensions and multiple objects onto a real scene, and can provide different 3D information based on the user's focus, using a single computer-generated hologram per color channel. The holograms of the target scene are efficiently generated using a hologram generation method based on two-step propagation and singular value decomposition of the Fresnel transform impulse response function. A holographic display is implemented using a phase-only spatial light modulator and time-division multiplexing for color reproduction, demonstrating superior quality and computation speed compared to other hologram generation techniques.
SCIENTIFIC REPORTS
(2023)
Article
Engineering, Biomedical
Fan Zhang, Carlo M. Contreras, Pengfei Shao, Liping Zhao, Bingxuan Wu, Chenmeng Li, Feng Lin, Xiaohong Zhong, Zhongliang Lang, Peng Liu, Ronald X. Xu
Summary: Telemedicine has the potential to overcome unequal distribution of medical resources worldwide. The second-generation co-axial projective imaging (CPI-2) system has been developed for augmented reality surgical telementoring and has shown promising performance in benchtop experiments and skin cancer surgery.
ANNALS OF BIOMEDICAL ENGINEERING
(2022)
Article
Optics
Xiao-Li Ma, Rong-Ying Yuan, Lin-Bo Zhang, Min-Yang He, Han-Le Zhang, Yan Xing, Qiong-Hua Wang
Summary: In this paper, a novel augmented reality autostereoscopic 3D display based on sparse reflection array (SRA) is proposed. By utilizing a transparent LED display panel and a periodic SRA, the proposed display achieves a seamless fusion of real 3D objects and virtual 3D images. It offers higher light transmittance and thinner thickness compared to traditional autostereoscopic 3D displays based on parallax barrier or lenticular lens barrier. Experimental results demonstrate its superior display performance compared to conventional AR autostereoscopic 3D displays. This simple and versatile display can be applied in large-scale AR exhibition systems, glass curtain walls, and outdoor advertisements.
OPTICS COMMUNICATIONS
(2022)
Review
Optics
Zeyang Liu, Danyan Wang, Hao Gao, Moxin Li, Huixian Zhou, Cheng Zhang
Summary: Augmented reality (AR) display technology, which combines the physical and digital world, has received significant attention as the next-generation display technology. Current AR display systems suffer from limitations such as large size, chromatic aberration, and narrow field of view. The emerging technology of metasurface optics, featuring ultracompact footprint and flexible light-field modulation, offers potential solutions to overcome these limitations. This review summarizes the recent development of metasurface-enabled AR display technology, including the fundamentals of AR display, the concept and operating mechanisms of optical metasurfaces, and the performance improvement achieved by different metasurface devices.
ADVANCED PHOTONICS
(2023)
Article
Computer Science, Interdisciplinary Applications
Arne Seeliger, Long Cheng, Torbjorn Netland
Summary: Augmented reality (AR) technologies can increase workforce flexibility and productivity by providing real-time information where it's needed. This study develops an AR-based system for quality inspection using head-mounted displays (HMDs). The experiment shows that the AR HMD system improves task performance, reduces mental workload, and receives positive user experience ratings. This research fills the gap in the literature on AR-assisted quality control and provides empirical evidence of its benefits.
COMPUTERS IN INDUSTRY
(2023)
Review
Computer Science, Interdisciplinary Applications
Wei Fang, Lixi Chen, Tienong Zhang, Chengjun Chen, Zhan Teng, Lihui Wang
Summary: This article provides a comprehensive discussion on the issues surrounding the adoption of HMD AR in manufacturing. It offers an extensive map of its distribution in various manufacturing activities and a systematic overview of the technical perspectives associated with actual industrial applications. The article also presents a historical overview of the development of HMD AR and a summary of existing methods and open problems in manufacturing.
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING
(2023)
Article
Multidisciplinary Sciences
Oskari Pakari, Ricardo Lopez, Ivan Druckman, Emilee Meng, Erik Zhou, Ziang Wang, Shaun D. Clarke, Sara A. Pozzi
Summary: This article demonstrates the real-time visualization of gamma ray and neutron radiation detector data in mixed reality (MR) using Microsoft HoloLens 2 smart glasses, reducing the interpretation burden. By combining a state-of-the-art dual particle imaging system with HoloLens 2, the data is displayed directly to the user through the head-mounted MR smart glasses, providing an overlay of directional information to the user's 3D visual experience.
SCIENTIFIC REPORTS
(2023)
Article
Optics
Zi Wang, Xu Zhang, Guoqiang Lv, Qibin Feng, Hai Ming, Anting Wang
Summary: The study introduces two types of holographic Maxwellian displays, spherical wave type and plane wave type, and demonstrates through an optical experiment a hybrid method combining different wavefronts to achieve large depth of field and high image quality.
Article
Optics
Nyamsuren Darkhanbaatar, Munkh-Uchral Erdenebat, Chang-Won Shin, Ki-Chul Kwon, Kwon-Yeon Lee, Ganbat Baasantseren, Nam Kim
Summary: The paper introduces a three-dimensional see-through augmented-reality display system that uses holographic micromirror array instead of traditional waveguide technology, allowing for simple and effective display of three-dimensional images.
Article
Optics
Fei Lu, Jianyu Hua, Fengbin Zhou, Zhongwen Xia, Ruibin Li, Linsen Chen, Wen Qiao
Summary: This paper introduces a prototype of AR 3D display based on P-VHOE, which has high diffraction efficiency and fidelity. The prototype provides an efficient solution for glasses-free AR 3D display and has various potential applications.
Article
Multidisciplinary Sciences
Naveen Madapana, Glebys Gonzalez, Richard Rodgers, Lingsong Zhang, Juan P. Wachs
Article
Automation & Control Systems
Hairong Jiang, Bradley S. Duerstock, Juan P. Wachs
IEEE TRANSACTIONS ON CYBERNETICS
(2018)
Article
Neurosciences
Maria E. Cabrera, Keisha Novak, Dan Foti, Richard Voyles, Juan P. Wachs
EXPERIMENTAL BRAIN RESEARCH
(2020)
Article
Engineering, Biomedical
Ting Zhang, Bradley S. Duerstock, Juan P. Wachs
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING
(2020)
Article
Computer Science, Artificial Intelligence
Naveen Madapana, Glebys Gonzalez, Lingsong Zhang, Richard Rodgers, Juan Wachs
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS
(2020)
Article
Computer Science, Artificial Intelligence
Edgar Rojas-Munoz, Juan Wachs
Summary: Recent studies have shown that gestures are useful indicators of understanding, learning, and memory retention. The study introduces a new metric, PIA, to estimate task understanding by analyzing how collaborators use gestures to convey, assimilate, and execute physical instructions.
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS
(2021)
Article
Computer Science, Artificial Intelligence
Naveen Madapana, Juan Wachs
Summary: This study aims to investigate the impact of different feature extraction techniques on gesture recognition performance and proposes the Joint Semantic Encoder method. Regardless of attribute-based or cross-category conditions, JSE demonstrated a superior performance of 5% compared to other methods.
PATTERN ANALYSIS AND APPLICATIONS
(2022)
Article
Computer Science, Artificial Intelligence
Edgar Rojas-Munoz, Juan P. Wachs
Summary: This work presents a gesture-based approach to estimate task understanding and performance during remote ultrasound tasks, using gesture comparison and the PIA metric. The results show that the gesture comparison method outperforms others, with over 76% agreement with human baseline, and significant correlations between PIA and other task understanding metrics, indicating its effectiveness in estimating task understanding.
PATTERN ANALYSIS AND APPLICATIONS
(2021)
Article
Robotics
Chenxi Xiao, Naveen Madapana, Juan Wachs
Summary: The proposed framework utilizes a support set of CAD models to augment tactile observations, facilitating object recognition, visualization, and developing manipulation policies solely using tactile samples. By employing the uGPIS surface reconstruction method and prior knowledge from the CAD model support set, grasp regions can be successfully detected.
IEEE ROBOTICS AND AUTOMATION LETTERS
(2021)
Article
Computer Science, Cybernetics
Naveen Madapana, Daniela Chanci, Glebys Gonzalez, Lingsong Zhang, Juan P. Wachs
Summary: Touchless interfaces allow surgeons to control medical imaging systems autonomously in the Operating Room, and the choice of best gestures/commands is crucial for the efficiency of surgeon-computer interaction.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION
(2022)
Article
Robotics
Chenxi Xiao, Juan Wachs
Summary: The paper proposes a novel planner that optimizes nonmyopic exploration efficiency in remote, hazardous, and extreme exploration missions. The algorithm incorporates a new sampling algorithm and path optimization algorithm to achieve global path planning and minimize traveling cost. Experimental results demonstrate superior efficiency compared to myopic planners.
IEEE ROBOTICS AND AUTOMATION LETTERS
(2022)
Article
Robotics
Chenxi Xiao, Shujia Xu, Wenzhuo Wu, Juan Wachs
Summary: This article proposes an autonomous solution for exploring unknown task spaces based solely on tactile sensing. A whisker sensor is designed to acquire contact information from the environment, and a hybrid exploration policy is developed to increase the efficiency of object discovery. Scene understanding is facilitated through object segmentation and classification.
IEEE TRANSACTIONS ON ROBOTICS
(2022)
Article
Computer Science, Information Systems
Jing Li, Dong Hye Ye, Mathias Kolsch, Juan P. Wachs, Charles A. Bouman
Summary: Unmanned Aerial Vehicle (UAV) technology is being used in various applications, and the need for UAV to UAV detection and tracking systems is growing. Camera based see-and-avoid systems offer advantages in terms of weight and power consumption, but require efficient algorithms for autonomous detection and tracking. The proposed algorithm can achieve accurate detection and tracking of distant and faint UAVs.
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING
(2022)
Article
Health Care Sciences & Services
Edgar Rojas-Munoz, Chengyuan Lin, Natalia Sanchez-Tamayo, Maria Eugenia Cabrera, Daniel Andersen, Voicu Popescu, Juan Antonio Barragan, Ben Zarzaur, Patrick Murphy, Kathryn Anderson, Thomas Douglas, Clare Griffis, Jessica McKee, Andrew W. Kirkpatrick, Juan P. Wachs
NPJ DIGITAL MEDICINE
(2020)
Article
Computer Science, Artificial Intelligence
Ting Zhang, Yu-Ting Li, Juan P. Wachs
ACM TRANSACTIONS ON INTERACTIVE INTELLIGENT SYSTEMS
(2017)