Article
Chemistry, Analytical
Yumei Li, Ningfang Liao, Wenmin Wu, Chenyang Deng, Yasheng Li, Qiumei Fan, Chuanjie Liu
Summary: This study aims to solve the difficulties in displaying high dynamic range (HDR) images on conventional standard display devices. The proposed modified tone-mapping operator (TMO), called iCAM06-m, combines iCAM06 and a multi-scale enhancement algorithm to compensate for saturation and hue drift. Subjective evaluation shows the better performance of iCAM06-m compared to other TMOs, confirming the effectiveness of chroma compensation and multi-scale decomposition. The proposed algorithm overcomes the limitations of other algorithms and is a good candidate for a general purpose TMO.
Article
Computer Science, Information Systems
Imran Mehmood, Xinye Shi, Muhammad Usman Khan, Ming Ronnier Luo
Summary: One of the key challenges in tone mapping is to preserve the perceptual quality of high dynamic range (HDR) images when mapping them to standard dynamic range (SDR) displays. This research proposes a new tone mapping operator (TMOz) that leverages CIECAM16 perceptual attributes to achieve more optimal colorfulness reproduction. Both objective and subjective evaluations show that the proposed model outperforms existing TMO algorithms.
Review
Engineering, Electrical & Electronic
Xueyu Han, Ishtiaq Rasool Khan, Susanto Rahardja
Summary: Compared to conventional digital imaging, high dynamic range (HDR) image tone mapping technology faithfully reproduces real-world scenes on common displays for enhanced viewing experience. This paper presents a literature review and benchmarks of existing tone mapping methods, providing updated information and paving the way for further developments in the field.
DIGITAL SIGNAL PROCESSING
(2023)
Article
Chemistry, Analytical
Ivana Shopovska, Ana Stojkovic, Jan Aelterman, David Van Hamme, Wilfried Philips
Summary: Intelligent driver assistance systems are increasingly popular and have the ability to detect vulnerable road users. However, standard imaging sensors perform poorly in strong illumination contrast conditions. This study focuses on the use of HDR imaging sensors and the need for tone mapping in vehicle perception systems. The proposed DI-TM method achieves the best performance in terms of detection metrics in challenging dynamic range conditions, with a 13% improvement compared to existing methods.
Article
Engineering, Electrical & Electronic
Pang Zebang, Lu Bibo, Gu Yanan, Zheng Yanmei, Zhang Ming
Summary: The proposed algorithm effectively compresses the dynamic range of the image, maintains color information, and enhances features such as edge and texture details through cross decomposition and reconstruction.
LASER & OPTOELECTRONICS PROGRESS
(2021)
Article
Anatomy & Morphology
Harbinder Singh, Gabriel Cristobal, Saul Blanco, Gloria Bueno, Carlos Sanchez
Summary: This study utilizes high dynamic range imaging to examine the cell structure of diatoms, using multi-scale decomposition and tone mapping methods to extract more details, and evaluates its performance through quantitative and qualitative analysis.
MICROSCOPY RESEARCH AND TECHNIQUE
(2021)
Article
Computer Science, Information Systems
Nam Hoang Nguyen, Tu Van Vo, Chul Lee
Summary: This study introduces an optimized tone-mapping algorithm based on human visual system response model to preserve perceptual responses between HDR and SDR devices, improving image quality. By efficiently solving optimization problems to obtain the optimal tone-mapping curve, experimental results demonstrate the algorithm's superiority in subjective and objective evaluations compared to conventional algorithms.
Article
Engineering, Electrical & Electronic
Pedram Mohammadi, Mahsa T. Pourazad, Panos Nasiopoulos
Summary: The introduction of High Dynamic Range (HDR) technologies has brought about significant visual improvements and opened up new markets for a wide range of industries. Owners of legacy Standard Dynamic Range (SDR) content now have the opportunity to convert their content to the HDR standard and take advantage of the enhanced capabilities of HDR displays. A novel high visual quality video inverse Tone Mapping Operator (iTMO) has been proposed, which is based on human visual perception and employs a segmentation method according to the Human Visual System (HVS) sensitivity, resulting in high visual quality HDR videos.
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY
(2021)
Article
Mathematical & Computational Biology
Ishtiaq Rasool Khan, Susanto Rahardja
Summary: This paper proposes a unified structure that can represent any global tone-mapping algorithm with a small array of coefficients. The unified implementation can convert HDR images and videos to LDR in real time, producing identical LDR images to the original algorithm. It has low and fixed execution time, independent of algorithm and content type.
MATHEMATICAL BIOSCIENCES AND ENGINEERING
(2022)
Article
Engineering, Electrical & Electronic
Fei Zhou, Guangsen Liao, Jiang Duan, Bozhi Liu, Guoping Qiu
Summary: This paper presents a new region-adaptive self-supervised deep learning technique for HDR image tone mapping. The experimental results demonstrate that this technique achieves excellent performance in preserving overall contrasts, revealing fine details, and eliminating visual artifacts.
SIGNAL PROCESSING-IMAGE COMMUNICATION
(2022)
Article
Computer Science, Software Engineering
Yufan Zhang, Wenbiao Zhou, Jinling Xu
Summary: This paper proposes a dynamic range adjustable inverse tone mapping algorithm based on single LDR image, which combines photoreceptor response and adaptation. It can effectively reconstruct HDR images and reduce distortion.
Article
Chemistry, Analytical
Wojciech Jamrozik, Jacek Gorka, Gilmar Ferreira Batalha
Summary: Temperature is a crucial parameter in fusion welding. Global approaches and multiscale decomposition methods were investigated for dynamic range compression of IR images to enhance visibility of low-contrast details. Methods based on wavelet transforms were found to be the most suitable, although they generated relatively large local noise.
Article
Engineering, Multidisciplinary
Hongdi Liu, Jiahao Fu, Linli Tian, Dahu Zhu
Summary: In this study, a convergent binocular vision algorithm under extended imaging dynamic range is proposed to guide the machining robot for precise positioning. The experimental results indicate that the high dynamic images synthesized by the proposed algorithm enhance the positioning accuracy of the machining robot to the target workpiece.
Article
Optics
Nabeel A. Riza, Nazim Ashraf
Summary: A calibration target optimized method for finding the Camera Response Function (CRF) for a digital image sensor-based camera is demonstrated in this study. The proposed method utilizes localized known target zone pixel outputs, spatial averaging, and histogram analysis for saturated pixel detection, resulting in a non-linear CRF with a limited linear zone. The method proves to be highly robust in recovering test targets using minimal exposures and multi-exposure imaging.
OPTICS COMMUNICATIONS
(2021)
Article
Computer Science, Information Systems
Siyeong Lee, So Yeon Jo, Gwon Hwan An, Suk-Ju Kang
Summary: The study introduces an inverse tone mapping method that uses a pair of neural networks to construct a multiple exposure image synthesis approach for recovering lost scene radiances and flexibly expanding the dynamic range of images. The method demonstrates significant advantages in HDR imaging compared to traditional methods.
IEEE TRANSACTIONS ON MULTIMEDIA
(2021)
Article
Computer Science, Theory & Methods
Daniel Martin, Sandra Malpica, Diego Gutierrez, Belen Masia, Ana Serrano
Summary: Virtual reality (VR) is a rapidly growing technology with the potential to revolutionize content creation and consumption. This survey examines the role and benefits of multimodality in VR, showcasing its importance in enhancing user experience, improving overall performance, and enabling unprecedented abilities in skill and knowledge transfer.
ACM COMPUTING SURVEYS
(2022)
Article
Computer Science, Software Engineering
J. Delanoy, M. Lagunas, J. Condor, D. Gutierrez, B. Masia
Summary: This article presents an image-based editing method that modifies the material appearance of an object by changing high-level perceptual attributes. The method utilizes a two-step generative network to drive appearance changes and generate images with high-frequency details. To train the network, the researchers augmented an existing material appearance dataset with perceptual judgments of high-level attributes obtained through crowd-sourced experiments, and employed training strategies that avoided the need for original-edited image pairs. The perception of appearance in the edited images was validated through a user study.
COMPUTER GRAPHICS FORUM
(2022)
Article
Computer Science, Software Engineering
Shinyoung Yi, Daniel S. Jeon, Ana Serrano, Se-Yoon Jeong, Hui-Yong Kim, Diego Gutierrez, Min H. Kim
Summary: Despite advances in display technology, many applications still rely on outdated psychophysical datasets. We conducted experiments to explore contrast sensitivity and developed a novel function that predicts human contrast sensitivity more accurately. We also provide a practical version that is backward compatible and consistently produces good results in existing applications.
COMPUTER GRAPHICS FORUM
(2022)
Article
Computer Science, Software Engineering
Daniel Martin, Ana Serrano, Alexander W. Bergman, Gordon Wetzstein, Belen Masia
Summary: Understanding and modeling human gaze behavior in 360 degrees environments is crucial for developing virtual reality applications. However, acquiring data on human behavior can be difficult and time-consuming. To address this, we propose ScanGAN360, a novel generative adversarial approach that generates virtual observers with scanpaths similar to real users.
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
(2022)
Article
Management
Carlos Maranes, Diego Gutierrez, Ana Serrano
Summary: Virtual Reality (VR) is becoming increasingly popular with the commercialization of personal devices. However, the development of Cinematic VR (CVR) content is still in the exploratory stage. Users have partial or complete control of the camera in this medium, which can hinder the delivery of a pre-established narrative. In particular, during movie cuts, viewers may miss key elements of the story. This work explores studies on viewers' behavior and provides guidelines and methods for filmmakers to make decisions during filming and editing.
INTERNATIONAL TRANSACTIONS IN OPERATIONAL RESEARCH
(2023)
Article
Ophthalmology
E. Esteban-Ibanez, T. Perez-Roche, E. Prieto, O. Castillo, A. Fanlo-Zarazaga, A. Alejandre, D. Gutierrez, M. Ortin, V. Pueyo
Summary: Visual acuity and contrast sensitivity are key measures in assessing visual function in children, with digital devices playing an increasingly important role in evaluation. Eye tracking technology enables objective and quick measurement of children's visual function without the need for experienced examiners.
INTERNATIONAL OPHTHALMOLOGY
(2022)
Article
Computer Science, Software Engineering
C. Wang, B. Chen, HP. Seidel, K. Myszkowski, A. Serrano
Summary: This paper introduces a learning-based self-supervised tone mapping operator that can be trained for each HDR image without any data labeling. The key novelty of this approach is the carefully designed loss function based on contrast perception, which allows for direct comparison of content in HDR and tone mapped images. Extensive studies and exploration of parameters demonstrate that this solution outperforms existing approaches in both objective and subjective metrics.
COMPUTER GRAPHICS FORUM
(2022)
Article
Multidisciplinary Sciences
Sandra Malpica, Belen Masia, Laura Herman, Gordon Wetzstein, David M. Eagleman, Diego Gutierrez, Zoya Bylinskii, Qi Sun
Summary: Time perception is influenced by manipulations to visual inputs, with changes in visual properties impacting both millisecond-level and longer interval time judgments. While high-level cognitive effects elicited by visual inputs affect time perception, they are difficult to measure and control due to confounding semantic information. This study investigates the impact of asemantic visual properties on interval time perception and reveals a consistent pattern where larger visual changes shorten perceived time in intervals up to 3 minutes, contrary to their effect on millisecond-level perception. These findings have significant real-world implications as they can alter participants' time perception.
Article
Computer Science, Software Engineering
Inseung Hwang, Daniel S. Jeon, Adolfo Munoz, Diego Gutierrez, Xin Tong, Min H. Kim
Summary: Ellipsometry techniques are used to measure the polarization information of materials, but traditional methods are time-consuming and require cumbersome devices. This paper presents a sparse ellipsometry method that can capture both polarimetric reflectance information and the 3D shape of objects using a portable device. The results are in strong agreement with a ground-truth dataset of polarimetric BRDFs of real-world objects.
ACM TRANSACTIONS ON GRAPHICS
(2022)
Article
Computer Science, Software Engineering
Edurne Bernal Berdun, Daniel Martin Serrano, Diego Gutierrez Perez, Belen Masia Corcoy
Summary: Virtual reality has the potential to change the way people consume content, but much is still unknown about the grammar and visual language of this new medium. This study proposes a novel saliency prediction model that combines spherical convolutions and recurrent neural networks to extract and model spatio-temporal features from 360 degrees videos. The model outperforms previous works and successfully mimics human visual attention when exploring dynamic 360 degrees videos.
COMPUTERS & GRAPHICS-UK
(2022)
Article
Optics
Diego Royo, Zesheng Huang, Yun Liang, Boyan Song, Adolfo Munoz, Diego Gutierrez, Julio Marco
Summary: This study proposes a novel method to compactly represent time-resolved illumination using mixtures of exponentially modified Gaussians. The method is robust to noise, preserves structural information, and achieves consistent results and quantitative improvements in applications such as hidden-scene reconstruction and depth estimation.
Editorial Material
Chemistry, Multidisciplinary
Ana Serrano, Qi Sun, Diego Gutierrez
APPLIED SCIENCES-BASEL
(2022)
Article
Computer Science, Software Engineering
Valentin Deschaintre, Julia Guerrero-Viu, Diego Gutierrez, Tamy Boubekeur, Belen Masia
Summary: This paper introduces a novel dataset called text2fabric, which links free-text descriptions to various fabric materials. The dataset consists of 15,000 natural language descriptions associated with 3,000 corresponding images of fabric materials. By analyzing the dataset, the authors identify a compact lexicon, set of attributes, and key structure that accurately describe fabrics and provide directions for generalization to other materials.
ACM TRANSACTIONS ON GRAPHICS
(2023)