4.7 Article

Motion Tracking for Medical Imaging: A Nonvisible Structured Light Tracking Approach

Journal

IEEE TRANSACTIONS ON MEDICAL IMAGING
Volume 31, Issue 1, Pages 79-87

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TMI.2011.2165157

Keywords

Motion estimation; positron emission tomography; stereo image processing; stereo vision; structured light system

Funding

  1. Siemens Healthcare A/S
  2. The Danish Agency for Science, Technology, and Innovation

Ask authors/readers for more resources

We present a system for head motion tracking in 3D brain imaging. The system is based on facial surface reconstruction and tracking using a structured light (SL) scanning principle. The system is designed to fit into narrow 3D medical scanner geometries limiting the field of view. It is tested in a clinical setting on the high resolution research tomograph (HRRT), Siemens PET scanner with a head phantom and volunteers. The SL system is compared to a commercial optical tracking system, the Polaris Vicra system, from NDI based on translatory and rotary ground truth motions of the head phantom. The accuracy of the systems was similar, with root mean square (rms) errors of 0.09 degrees for axial rotations, and rms errors of 0.24 mm for +/- 25 mm translations. Tests were made using 1) a light emitting diode (LED) based miniaturized video projector, the Pico projector from Texas Instruments, and 2) a customized version of this projector replacing a visible light LED with a 850 nm near infrared LED. The latter system does not provide additional discomfort by visible light projection into the patient's eyes. The main advantage over existing head motion tracking devices, including the Polaris Vicra system, is that it is not necessary to place markers on the patient. This provides a simpler workflow and eliminates uncertainties related to marker attachment and stability. We show proof of concept of a marker less tracking system especially designed for clinical use with promising results.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Radiology, Nuclear Medicine & Medical Imaging

Prospective motion correction for diffusion weighted EPI of the brain using an optical markerless tracker

Johan Berglund, Adam van Niekerk, Henric Ryden, Tim Sprenger, Enrico Avventi, Ola Norbeck, Stefan L. Glimberg, Oline V. Olesen, Stefan Skare

Summary: This study utilized an optical markerless tracking system for real-time rigid body motion correction during scanning, enabling motion-robust diffusion weighted imaging of the brain. Prospective motion correction with dynamic ghost correction allowed for high quality DWI images in the presence of fast and continuous motion within a 10 degrees range.

MAGNETIC RESONANCE IN MEDICINE (2021)

Article Radiology, Nuclear Medicine & Medical Imaging

Comparison of prospective and retrospective motion correction in 3D-encoded neuroanatomical MRI

Jakob M. Slipsager, Stefan L. Glimberg, Liselotte Hojgaard, Rasmus R. Paulsen, Paul Wighton, M. Dylan Tisdall, Camilo Jaimes, Borjan A. Gagoski, P. Ellen Grant, Andre van Der Kouwe, Oline V. Olesen, Robert Frost

Summary: Comparing prospective motion correction (PMC) and retrospective motion correction (RMC) in Cartesian 3D-encoded MPRAGE scans showed that PMC resulted in superior image quality compared to RMC, with increasing correction frequency reducing motion artifacts in RMC.

MAGNETIC RESONANCE IN MEDICINE (2022)

Article Computer Science, Artificial Intelligence

Deep metric learning for otitis media classification

Josefine Vilsboll Sundgaard, James Harte, Peter Bray, Soren Laugesen, Yosuke Kamide, Chiemi Tanaka, Rasmus R. Paulsen, Anders Nymark Christensen

Summary: This study proposes an automatic diagnostic algorithm for detecting otitis media based on deep metric learning, comparing different distance-based metric loss functions. The results are comparable to the best clinical experts, paving the way for more accurate and operator-independent diagnosis of otitis media.

MEDICAL IMAGE ANALYSIS (2021)

Article Physiology

Deep Learning Framework for Real-Time Estimation of in-silico Thrombotic Risk Indices in the Left Atrial Appendage

Xabier Morales Ferez, Jordi Mill, Kristine Aavild Juhl, Cesar Acebes, Xavier Iriart, Benoit Legghe, Hubert Cochet, Ole De Backer, Rasmus R. Paulsen, Oscar Camara

Summary: This study successfully predicted the endothelial cell activation potential (ECAP), an index linked to thrombosis risk, solely based on patient-specific LAA morphology using a deep learning model. Evaluation of various DL approaches showed that the graph-based DL model outperformed others and demonstrated adaptability in a more realistic dataset.

FRONTIERS IN PHYSIOLOGY (2021)

Article Otorhinolaryngology

Inter-rater reliability of the diagnosis of otitis media based on otoscopic images and wideband tympanometry measurements

Josefine Vilsboll Sundgaard, Maria Varendh, Franziska Nordstrom, Yosuke Kamide, Chiemi Tanaka, James Harte, Rasmus R. Paulsen, Anders Nymark Christensen, Peter Bray, Soren Laugesen

Summary: This study investigates the inter-rater reliability and agreement of the diagnosis of otitis media with effusion, acute otitis media, and no effusion cases based on otoscopy images and wideband tympanometry measurements. The results show high inter-rater reliability for diagnosing acute otitis media, lower for diagnosing otitis media with effusion. Wideband tympanometry can provide valuable information for diagnosis, and the diagnostic certainty increases when examined together with otoscopy images.

INTERNATIONAL JOURNAL OF PEDIATRIC OTORHINOLARYNGOLOGY (2022)

Article Computer Science, Information Systems

Estimation of Apnea-Hypopnea Index Using Deep Learning On 3-D Craniofacial Scans

Umaer Hanif, Eileen B. Leary, Logan D. Schneider, Rasmus R. Paulsen, Anne Marie Morse, Adam Blackman, Paula K. Schweitzer, Clete A. Kushida, Stanley Y. Liu, Poul Jennum, Helge B. D. Sorensen, Emmanuel J. M. Mignot

Summary: This study analyzed 3D craniofacial scans of 1366 patients with obstructive sleep apnea (OSA) to predict apnea-hypopnea index (AHI) using a machine learning algorithm, achieving a mean absolute error of 11.38 events/hour and 67% accuracy for predicting OSA. The algorithm has potential to serve as an inexpensive and efficient screening tool for individuals with suspected OSA.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2021)

Article Computer Science, Information Systems

A Deep Learning Approach for Detecting Otitis Media From Wideband Tympanometry Measurements

Josefine Vilsboll Sundgaard, Peter Bray, Soren Laugesen, James Harte, Yosuke Kamide, Chiemi Tanaka, Anders Nymark Christensen, Rasmus R. Paulsen

Summary: In this study, an automatic diagnostic algorithm based on wideband tympanometry measurements is proposed for detecting otitis media. A convolutional neural network is developed for classification of otitis media using the analysis of the wideband tympanogram. Results show high performance in overall otitis media detection, although specific types of otitis media cannot be distinguished.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2022)

Article Computer Science, Software Engineering

Neural Representation of Open Surfaces

T. V. Christiansen, J. A. Baerentzen, R. R. Paulsen, M. R. Hannemose

Summary: Neural implicit surfaces are effective for representing shapes with arbitrary topology, but open surfaces are still challenging. The generalized winding number (GWN) is a promising approach for distinguishing points on 3D shapes. However, it lacks information about the distance to the surface, which is necessary for tasks like ray tracing. To address this, we propose the semi-signed distance field (SSDF) representation, which combines the GWN and surface distance. We compare the GWN and SSDF for various applications and find that both are suitable for neural representation of open surfaces.

COMPUTER GRAPHICS FORUM (2023)

Proceedings Paper Computer Science, Artificial Intelligence

Accurate Localization of Inner Ear Regions of Interests Using Deep Reinforcement Learning

Ana-Teodora Radutoiu, Francois Patou, Jan Margeta, Rasmus R. Paulsen, Paula Lopez Diez

Summary: We propose a novel method for automatic ROI extraction in full head CT scans to isolate the inner ear. By utilizing state-of-the-art communicative multi-agent reinforcement learning and specifically designed landmarks, we are able to robustly extract ROIs with the same orientation and relevant anatomy.

MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2022 (2022)

Proceedings Paper Computer Science, Artificial Intelligence

Was that so Hard? Estimating Human Classification Difficulty

Morten Rieger Hannemose, Josefine Vilsboll Sundgaard, Niels Kvorning Ternov, Rasmus R. Paulsen, Anders Nymark Christensen

Summary: In this paper, methods for estimating the difficulty of diagnosing medical image cases by doctors are introduced, using embeddings obtained with deep metric learning. A practical method for obtaining ground truth human difficulty is also presented. Experimental results on two medical datasets show that our methods outperform existing ones.

APPLICATIONS OF MEDICAL ARTIFICIAL INTELLIGENCE, AMAI 2022 (2022)

Proceedings Paper Neuroimaging

Deep Reinforcement Learning for Detection of Inner Ear Abnormal Anatomy in Computed Tomography

Paula Lopez Diez, Kristine Sorensen, Josefine Vilsboll Sundgaard, Khassan Diab, Jan Margeta, Francois Patou, Rasmus R. Paulsen

Summary: This paper proposes a framework for inner ear abnormality detection based on a deep reinforcement learning model. By training on normative data only, the framework extracts two abnormality measurements: the variability of the predicted configuration of landmarks in a subspace formed by shape alignment and projection, and the distribution of predicted Q-values before landmark localization. The implementation shows outstanding performance on artificial and real clinical CT datasets, suggesting potential applications in solving other complex anomaly detection problems.

MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT III (2022)

Proceedings Paper Engineering, Biomedical

NUDF: NEURAL UNSIGNED DISTANCE FIELDS FOR HIGH RESOLUTION 3D MEDICAL IMAGE SEGMENTATION

Kristine Sorensen, Oscar Camara, Ole de Backer, Klaus F. Kofoed, Rasmus R. Paulsen

Summary: Medical image segmentation involves labelling each pixel or voxel as inside or outside a given anatomy. The proposed NUDF method learns Unsigned Distance Field directly from the image, allowing for high-resolution processing with small memory requirements. The method accurately predicts 3D mesh models of the complex and variable LAA shape, capturing its details.

2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022) (2022)

Proceedings Paper Computer Science, Artificial Intelligence

Implicit Neural Distance Representation for Unsupervised and Supervised Classification of Complex Anatomies

Kristine Aavild Juhl, Xabier Morales, Ole de Backer, Oscar Camara, Rasmus Reinhold Paulsen

Summary: This study focuses on surface representations of complex anatomies using a novel Implicit Neural Distance Representation based on unsigned distance fields. The optimized latent space contains important global shape information useful for reconstructing anatomies and successfully separating different anatomies. The representation is also shown to be effective in gender classification of human face geometries.

MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT II (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Facial and Cochlear Nerves Characterization Using Deep Reinforcement Learning for Landmark Detection

Paula Lopez Diez, Josefine Vilsboll Sundgaard, Francois Patou, Jan Margeta, Rasmus Reinhold Paulsen

Summary: This study introduces a pipeline for characterizing facial and cochlear nerves in CT scans, utilizing deep reinforcement learning and key landmark definition. The method accurately locates these nerves and provides reliable measurements for computer-aided diagnosis and surgery planning.

MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT IV (2021)

Proceedings Paper Engineering, Biomedical

Multi-planar whole heart segmentation of 3D CT images using 2D spatial propagation CNN

Josefine Vilsboll Sundgaard, Kristine Aavild Juhl, Klaus Fuglsang Kofoed, Rasmus R. Paulsen

Summary: Automated segmentation of cardiac CT scans using 2D convolutional neural networks with multi-planar approach and spatial propagation addresses the limitations of 3D networks, ensuring spatial consistency and achieving promising results on challenging datasets.

MEDICAL IMAGING 2020: IMAGE PROCESSING (2021)

No Data Available