4.7 Article

Holovideo: Real-time 3D range video encoding and decoding on GPU

Journal

OPTICS AND LASERS IN ENGINEERING
Volume 50, Issue 2, Pages 280-286

Publisher

ELSEVIER SCI LTD
DOI: 10.1016/j.optlaseng.2011.08.002

Keywords

3D range data compression; 3D video processing; Graphics processing unit (GPU); Fringe analysis

Categories

Funding

  1. Div Of Civil, Mechanical, & Manufact Inn
  2. Directorate For Engineering [1150711] Funding Source: National Science Foundation

Ask authors/readers for more resources

We present a 3D video-encoding technique called Holovideo that is capable of encoding high-resolution 3D videos into standard 2D videos, and then decoding the 2D videos back into 3D rapidly without significant loss of quality. Due to the nature of the algorithm, 2D video compression such as JPEG encoding with QuickTime Run Length Encoding (QTRLE) can be applied with little quality loss, resulting in an effective way to store 3D video at very small file sizes. We found that under a compression ratio of 134:1, Holovideo to OBJ file format, the 3D geometry quality drops at a negligible level. Several sets of 3D videos were captured using a structured light scanner, compressed using the Holovideo codec, and then uncompressed and displayed to demonstrate the effectiveness of the codec. With the use of OpenGL Shaders (GLSL), the 3D video codec can encode and decode in realtime. We demonstrated that for a video size of 512 x 512, the decoding speed is 28 frames per second (FPS) with a laptop computer using an embedded NVIDIA GeForce 9400 m graphics processing unit (GPU). Encoding can be done with this same setup at 18 FPS, making this technology suitable for applications such as interactive 3D video games and 3D video conferencing. (C) 2011 Elsevier Ltd. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Materials Science, Ceramics

Mechanical properties of B4C-CrB2 binary eutectic composites prepared by arc-melting

Rong Tu, Jiaojiao Li, Mingpu Jia, Qizhong Li, Meijun Yang, Song Zhang, Takashi Goto

Summary: B4C-CrB2 composites were prepared by arc-melting using B4C and CrB2 powders as raw materials. The eutectic composition of B4C-CrB2 system was 30B(4)C-70CrB(2) (mol%) with a labyrinth-like irregularly layered eutectic microstructure. The composites exhibited maximum Vickers hardness (24.6 GPa) and fracture toughness (4.3 MPa m(1/2)) at room temperature.

INTERNATIONAL JOURNAL OF APPLIED CERAMIC TECHNOLOGY (2023)

Article Materials Science, Multidisciplinary

Modulating Surface Machining to Optimize Work Hardening and Corrosion Behavior in 304 Austenitic Stainless Steel

C. L. Wu, T. Zhao, S. Zhang, Z. Y. Wang, C. H. Zhang, J. Z. Tan

Summary: Surface machining techniques such as cutting, rolling, and grinding were used to machine 304 austenitic stainless steels in order to enhance the hardening layer and corrosion resistance. Among the tested samples, the rolling sample exhibited the best surface quality with the lowest surface roughness and fewest defects. The rolling sample also displayed the highest degree of work hardening and corrosion resistance, attributed to the residual compressive stress and fewer micro-defects.

JOURNAL OF MATERIALS ENGINEERING AND PERFORMANCE (2023)

Article Chemistry, Analytical

Semi-Global Matching Assisted Absolute Phase Unwrapping

Yi-Hong Liao, Song Zhang

Summary: This paper presents an absolute phase unwrapping method for high-speed three-dimensional shape measurement on a single-camera, single-projector structured light system. The method utilizes speckle-embedded three-step phase-shifted patterns to obtain the wrapped phase of the object and employs the Semi-Global Matching (SGM) algorithm to establish the coarse correspondence between images. A computational framework is then used to determine the fringe order pixel by pixel. The experimental results demonstrate the high-speed and high-quality 3D measurements achieved by the proposed method for complex scenes.

SENSORS (2023)

Article Chemistry, Multidisciplinary

Synthesis of a crystalline zeolitic imidazole framework-8 nano-coating on single environment-sensitive viral particles for enhanced immune responses

Liuyang Wang, Xuan Lin, Yanan Sheng, Hongyu Zhu, Zhengjun Li, Zhiguo Su, Rong Yu, Songping Zhang

Summary: The encapsulation of antigens with ZIF-8 provides advantages in vaccine development, but the synthesis conditions of ZIF-8 can be too harsh for sensitive viral antigens. This study explores the synthesis of ZIF-8 on an environment-sensitive antigen and demonstrates the importance of size and morphology in exerting adjuvant effects.

NANOSCALE ADVANCES (2023)

Article Chemistry, Physical

Understanding of deposition mechanism of vanadium on LiF with large mismatch by facing target sputtering (FTS)

Xiaole Song, Long Zheng, Rong Tu, Baifeng Ji, Jun Li, Song Zhang

Summary: V/LiF is an important window material for investigating phase transition of materials under ultra-high pressure, which is a fundamental issue in condensed matter physics. However, the large mismatch in lattice and thermal properties makes vanadium growth on LiF a big challenge. In this study, over 1.5 μm thick vanadium films were successfully grown on LiF using facing target sputtering (FTS), and transmission electron microscopy (TEM) observation revealed vertically well-aligned columnar crystals with numerous micro-sized gaps in the grown vanadium films. Particle-in-cell Monte Carlo collision (PIC-MCC) and Kinetic Monte Carlo (KMC) methods were used to simulate plasma discharge behavior, sputtered atom transport, and film growth to understand the deposition mechanism. A growth model of the vanadium film was established based on experimental and simulation results, and the micro-sized gaps in the columnar crystals were found to contribute to the release of residual stresses caused by the large mismatch, which can be explained by the grain boundary relaxation model.

APPLIED SURFACE SCIENCE (2023)

Article Fisheries

Brown sugar addition enhanced nutrient removal rates, growth performance, and bacterial community in a rice straw-based biofloc shrimp culture system

Felix Gyawu Addo, Songhe Zhang, Benjamin Manirakiza, Yu Ma, Shudong Yuan, Salah Alden Alklaf, Shaozhuang Guo, Godwin Abakari

Summary: In this study, a 30-day culture trial was conducted to investigate the effects of brown sugar addition on nutrient removal, feed conversion ratio, growth performance, and microbial community in a rice straw-based biofloc shrimp system. The results showed that the addition of brown sugar significantly reduced ammonium and nitrite nitrogen concentrations and improved nutrient removal rates. Furthermore, the addition of brown sugar also resulted in lower feed conversion ratio and higher shrimp survival rates. The dominant microbial phyla identified in all treatments played a crucial role in nutrient cycling and promoting water quality.

AQUACULTURE (2023)

Article Environmental Sciences

Eichhornia crassipes-rhizospheric biofilms contribute to nutrients removal and methane oxidization in wastewater stabilization ponds receiving simulative sewage treatment plants effluents

Xin He, Songhe Zhang, Xin Lv, Min Liu, Yu Ma, Shaozhuang Guo

Summary: This study investigated the role of rhizospheric biofilms on methane release in wastewater stabilization ponds (WSPs) with floating plants. The results showed that E. crassipes effectively reduced methane release and nutrients, with a higher inhibition effect on CH4 fluxes in treatments with high nutrients. Additionally, the rhizospheric bacterial community contributed to nutrients removal. In conclusion, E. crassipes plants play an important role in reducing methane release and nutrients removal.

CHEMOSPHERE (2023)

Article Environmental Sciences

Vallisneria natans decreased CH4 fluxes in wetlands: Interactions among plant physiological status, nutrients and epiphytic bacterial community

Liu Yang, Songhe Zhang, Xin Lv, Yuansi Liu, Shaozhuang Guo, Xiuren Hu, Benjamin Manirakiza

Summary: This study investigated the impacts of Vallis-neria natans senescence on methanotroph community and methane release in wetlands. The results showed that nutrient loadings increased methane fluxes, while healthy V. natans plants reduced methane flux. Environmental parameters and the physiological status of V. natans affected methanotrophs.

ENVIRONMENTAL RESEARCH (2023)

Review Materials Science, Multidisciplinary

Research Progress on Mechanical Properties of 3D Printed Biomedical Titanium Alloys

Ying Sun, Wenchao Hu, Chenliang Wu, Hai Kuang, Jie Wang, Song Zhang, Tingting Yan, Qiang Wang

Summary: This paper reviews the research progress of 3D printing titanium alloys, focusing on the basic phases, alloying elements and mechanical properties of titanium alloys, and discusses the effects of defects, microstructures and surface roughness on fatigue properties. It also introduces the research progress of mechanical properties of porous titanium alloys, including the influence of structural design, microstructure and surface roughness on fatigue properties. Finally, future development trends and potential research topics are pointed out.

JOURNAL OF MATERIALS ENGINEERING AND PERFORMANCE (2023)

Article Materials Science, Coatings & Films

Effects of gradient structure and modulation period of Ta/TaN/Ta(C,N)/Ta-DLC multilayer coatings prepared by HiPIMS

Qizhong Li, Tao Huang, Mai Yang, Tenghua Gao, Baifeng Ji, Song Zhang, Lianmeng Zhang, Rong Tu

Summary: Hard coatings with gradient and multilayer structures were prepared by high-power pulsed magnetron sputtering. The modulation period was found to significantly affect the microstructure, mechanical, and tribological properties of the coatings. Shorter modulation periods improved the adhesion strength and resulted in higher hardness and lower friction coefficients.

SURFACE & COATINGS TECHNOLOGY (2023)

Article Genetics & Heredity

Ovulatory signal-triggered chromatin remodeling in ovarian granulosa cells by HDAC2 phosphorylation activation-mediated histone deacetylation

Jiamin Jin, Peipei Ren, Xiang Li, Yinyi Zhang, Weijie Yang, Yerong Ma, Mengru Lai, Chao Yu, Songying Zhang, Yin-Li Zhang

Summary: Histone deacetylation is observed in granulosa cells during the process of ovulation, which is mediated by FSH and hCG. This process is regulated by CK2 alpha-mediated HDAC2 phosphorylation and is essential for successful ovulation.

EPIGENETICS & CHROMATIN (2023)

Article Obstetrics & Gynecology

The impact of endometrial scratch performed in mid-luteal phase on the endometrium whole genome transcriptomic profiles in following menstrual cycle

Yichao Tian, Jin Huang, Chi-Chiu Wang, Huizhen Lin, Xiaona Huang, Yue Zhao, Liu Liu, Songying Zhang

Summary: The value of endometrial scratch in women with recurrent embryo transfer is controversial, and it is unclear if endometrial scratch in the previous mid-luteal phase affects the whole genome transcriptomic profile of peri-implantation endometrium in the subsequent cycle.

HUMAN FERTILITY (2023)

Article Chemistry, Physical

Numerical Simulation of Physical Fields during Spark Plasma Sintering of Boron Carbide

Song Zhang, Wei Liu, Weimin Wang, Ying Gao, Aiyang Wang, Qianglong He, Wenhui Bai, Runfeng Li

Summary: This article uses a thermal-electric-mechanical coupled model to simulate the spark plasma sintering process of boron carbide, and conducts parameter optimization and simulation analysis.

MATERIALS (2023)

Article Materials Science, Ceramics

Additive manufacturing of continuous carbon fiber-reinforced silicon carbide ceramic composites

Kai Liu, Lei Qiu, Yuzhen Zhang, Yanying Du, Ce Sun, Song Zhang, Rong Tu, Yanjiao Wu, Huajun Sun, Yusheng Shi

Summary: A material extrusion (MEX) technology was developed for additive manufacturing of continuous carbon fiber-reinforced silicon carbide ceramic (C-f/SiC) composites. A slurry with high solid loading and viscosity was proposed based on rheological properties. Complex structures of C-f/SiC composites were printed using this MEX technique. Phenolic resin impregnation-carbonization process and reactive melting infiltration (RMI) were used to prepare samples with different C-f contents, with the highest bending strength and fracture toughness achieved at 1 K C-f content.

INTERNATIONAL JOURNAL OF APPLIED CERAMIC TECHNOLOGY (2023)

Article Chemistry, Analytical

Human Respiration Rate Measurement with High-Speed Digital Fringe Projection Technique

Anna Lena Lorenz, Song Zhang

Summary: This paper presents a non-contact continuous respiration monitoring method based on Fringe Projection Profilometry (FPP), which overcomes the limitations of traditional intrusive techniques by providing continuous monitoring without interfering with normal breathing. The FPP sensor captures three-dimensional respiratory motion from the chest wall and abdomen, and the analysis algorithms extract respiratory parameters. The experimental results demonstrate high signal-to-noise ratio and good correlation with a reference signal obtained from a spirometer.

SENSORS (2023)

Article Optics

Correspondence imaging through complex scattering media with temporal correction

Yin Xiao, Lina Zhou, Wen Chen

Summary: This paper introduces a correspondence imaging approach for reconstructing high-quality objects through complex scattering media. By deriving a rectified theory and introducing temporal correction, the proposed method eliminates the effect of dynamic scaling factors. Experimental results demonstrate the advantages of the proposed method over conventional methods in complex scattering environments, and it can also be combined with other methods to further enhance the quality of reconstructed objects.

OPTICS AND LASERS IN ENGINEERING (2024)

Article Optics

High-efficiency spin-selected multi-foci terahertz metalens

Zengxuan Jiang, Minghao Chao, Qingsong Liu, Bo Cheng, Guofeng Song, Jietao Liu

Summary: In this paper, a multi-focal metalens with high focusing efficiency controlled by circular polarization multiplexing is demonstrated. The metalens can generate four transversely distributed focal points under normal incidence of linearly polarized light, supporting both left-circularly polarized and right-circularly polarized conversion. Furthermore, an oblique incidence metalens is designed to achieve high total focusing efficiency for terahertz waves and provides potential new applications for polarization imaging and detection.

OPTICS AND LASERS IN ENGINEERING (2024)

Article Optics

A non-iterative frame-reduced structured illumination microscopy using checkerboard modulation

Yiran Wang, Yu Ji, Xuyang Zhou, Xiu Wen, Yutong Li, Zhengjun Liu, Shutian Liu

Summary: This work presents a new reconstruction framework for structured illumination microscopy (SIM), which only requires four raw images and avoids extensive iterative computation. By using checkerboard pattern illumination modulation instead of sinusoidal fringe illumination, the proposed method significantly reduces image acquisition time and achieves higher image reconstruction rate. Additionally, the reconstruction process is non-iterative and not limited by the field of view size.

OPTICS AND LASERS IN ENGINEERING (2024)

Article Optics

The intrinsic mode activation and evolution in fiber splicing based on 3D refractive index profile characterization

Qian He, Li Pei, Jianshuai Wang, Jingjing Zheng, Tigang Ning, Jing Li

Summary: This paper proposes a 3D refractive index profile visualization method to demonstrate mode activation and evolution in fiber fusion splicing. The method is validated through experimental results and provides support for various fiber splicing operations and mode coupling modulation.

OPTICS AND LASERS IN ENGINEERING (2024)

Article Optics

Lenslet-array-based snapshot hyperspectral imaging polarimeter using opposite spectral modulation

Qiwei Li, Qiyu Wang, Fang Lu, Yang Cao, Xu Zhao

Summary: LSHIP is a lenslet-array-based snapshot hyperspectral imaging polarimeter that combines spectral polarization modulation with integral field imaging spectrometry. It can simultaneously acquire three-dimensional spatial and spectral data-cubes for linear Stokes parameters in a single snapshot.

OPTICS AND LASERS IN ENGINEERING (2024)

Article Optics

Temperature compensation of fiber optic unbalanced interferometers for high resolution static strain sensing

Huicong Li, Bing Lv, Meng Tian, Wenzhu Huang, Wentao Zhang

Summary: This study proposes a temperature compensation scheme for unbalanced interferometers using sensing fibers with different temperature coefficients, aiming to resolve the temperature disturbance and achieve high strain resolution. The experimental results confirm the effectiveness of the proposed scheme in high-resolution, long-term, low-frequency, and static strain sensing.

OPTICS AND LASERS IN ENGINEERING (2024)

Article Optics

Non-mechanical axial focus tuning by coherent beam combining technique

Hongxiang Chang, Rongtao Su, Yuqiu Zhang, Bowang Shu, Jinhu Long, Jinyong Leng, Pu Zhou

Summary: High-speed variable-focus optics provides new opportunities for fiber laser applications in various fields. This paper investigates a non-mechanical axial focus tuning method using coherent beam combining (CBC) technique and proposes a tilt modulation assisted method to extend the tuning range.

OPTICS AND LASERS IN ENGINEERING (2024)

Article Optics

Computational grayscale dithering phase measuring deflectomerty for accurate specular surface inspection

Yubo Ni, Shuai Fu, Chaoyang Su, Zhaozong Meng, Nan Gao, Zonghua Zhang

Summary: This paper proposes a surface adaptive fringe pattern generation method to accurately measure specular surfaces, eliminating the out-of-focus effect and improving measurement accuracy and reliability.

OPTICS AND LASERS IN ENGINEERING (2024)

Article Optics

Inhomogeneous thermal analysis of microlayer mold for glass molding of fast-axis collimation lens array

Zifan Wang, Tianfeng Zhou, Qian Yu, Zihao Zeng, Xibin Wang, Junjian Hu, Jiyong Zeng

Summary: Fast-axis collimation (FAC) lens arrays are crucial in laser systems, and their precision can be improved through the development of an optical collimation system and the use of thermal compensation to correct for non-uniform thermal expansion.

OPTICS AND LASERS IN ENGINEERING (2024)

Article Optics

Deep-learning accelerated super-resolution radial fluctuations (SRRF) enables real-time live cell imaging

Jincheng Chen, Qiuyu Fang, Li Huang, Xin Ye, Luhong Jin, Heng Zhang, Yinqian Luo, Min Zhu, Luhao Zhang, Baohua Ji, Xiang Tian, Yingke Xu

Summary: This study developed a novel deep learning accelerated SRRF method that enables super-resolution reconstruction with only 5 low SNR images, and allows real-time visualization of microtubule dynamics and interactions with CCPs.

OPTICS AND LASERS IN ENGINEERING (2024)

Article Optics

Deep neural networks with adaptive solution space for inverse design of multilayer deep-etched grating

Pan Liu, Yongqiang Zhao, Ning Li, Kai Feng, Seong G. Kong, Chaolong Tang

Summary: This article presents a technique for inverse design of multilayer deep-etched gratings (MDEG) using a deep neural network with adaptive solution space. The proposed method trains a deep neural network to predict the probability distribution across the discretized space, enabling evaluation of an optimal solution. The results show improved efficiencies using only a reduced dataset and avoiding one-to-many mapping challenges.

OPTICS AND LASERS IN ENGINEERING (2024)

Article Optics

Topological circular dichroism for asymmetric converging light beams

Evelina Bibikova, Nazar Al-wassiti, Nataliya Kundikova

Summary: Light beams possess three types of angular momentum, namely spin angular momentum, extrinsic orbital angular momentum, and intrinsic orbital angular momentum. The interaction between these momenta leads to the spin-orbit interaction of light and topological effects. This study predicts a new topological effect resulting from the influence of extrinsic orbital angular momentum on spin angular momentum in converging asymmetrical light beams. It manifests as the transformation of linear polarized light into elliptically polarized light when an asymmetrical beam passes through the left or right half of the focal plane. The measured value of the topological circular amplitude anisotropy R was found to be R = +/- (0.60 +/- 0.08) x 10(-3). This new effect contributes to our understanding of light and has potential applications in developing sensors in optics.

OPTICS AND LASERS IN ENGINEERING (2024)

Article Optics

Single-shot digital holography of multiple-beam Fizeau holograms for optical phase reconstruction through the focal depth of optical fibers

Hamdy H. Wahba

Summary: This study combines multiple-beam Fizeau interference and single-shot digital holographic interferometry to study thick phase objects. By collecting optical phase at different focal planes, the angular spectrum method is used for the first time to retrieve optical phase maps through the focal depth. The proposed method proves to be effective in providing accurate numerical focusing and phase maps reconstruction.

OPTICS AND LASERS IN ENGINEERING (2024)

Article Optics

Vision-based detection and coordinate metrology of a spatially encoded multi-sphere artefact

Mohammed A. Isa, Richard Leach, David Branson, Samanta Piano

Summary: Due to the complexity of resolving object form and pose in images, new vision algorithms prioritize identification and perception over accurate coordinate measurement. However, the use of planar targets for coordinate measurement in vision systems has several drawbacks, including calibration difficulties and limited viewing angles. On the other hand, the use of sphere targets is infrequent in vision-based coordinate metrology due to the lack of efficient multi-view vision algorithms for accurate sphere measurements.

OPTICS AND LASERS IN ENGINEERING (2024)

Article Optics

A review of automation of laser optics alignment with a focus on machine learning applications

Ildar Rakhmatulin, Donald Risbridger, Richard M. Carter, M. J. Daniel Esser, Mustafa Suphi Erden

Summary: This paper reviews the application of machine learning in laser systems. While machine learning has been widely used in general control automation and adjustment tasks, its application in specific tasks requiring skilled workforces for high-precision equipment assembly and adjustment is still limited. The paper presents promising research directions for using machine learning in mirror positional adjustment, triangulation, and optimal laser parameter selection, based on the recommendations of PRISMA.

OPTICS AND LASERS IN ENGINEERING (2024)