4.7 Article

Blind Quality Assessment of Tone-Mapped Images Via Analysis of Information, Naturalness, and Structure

Journal

IEEE TRANSACTIONS ON MULTIMEDIA
Volume 18, Issue 3, Pages 432-443

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TMM.2016.2518868

Keywords

High dynamic range; image quality assessment (IQA); information entropy; no-reference (NR); statistical naturalness; structural preservation; tone mapping

Funding

  1. Singapore MoE Tier 1 Project [M4011379, RG141/14]
  2. National Science Foundation of China [61025005, 61371146, 61221001, 61390514]

Ask authors/readers for more resources

High dynamic range (HDR) imaging techniques have been working constantly, actively, and validly in the fault detection and disease diagnosis in the astronomical and medical fields, and currently they have also gained much more attention from digital image processing and computer vision communities. While HDR imaging devices are starting to have friendly prices, HDR display devices are still out of reach of typical consumers. Due to the limited availability of HDR display devices, in most cases tone mapping operators (TMOs) are used to convert HDR images to standard low dynamic range (LDR) images for visualization. But existing TMOs cannot work effectively for all kinds of HDR images, with their performance largely depending on brightness, contrast, and structure properties of a scene. To accurately measure and compare the performance of distinct TMOs, in this paper develop an effective and efficient no-reference objective quality metric which can automatically assess LDR images created by different TMOs without access to the original HDR images. Our model is shown to be statistically superior to recent full-and no-reference quality measures on the existing tone-mapped image database and a new relevant database built in this work.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Geochemistry & Geophysics

Implicit Neural Representation Learning for Hyperspectral Image Super-Resolution

Kaiwei Zhang, Dandan Zhu, Xiongkuo Min, Guangtao Zhai

Summary: This paper proposes a novel hyperspectral image (HSI) super-resolution (SR) reconstruction model based on implicit neural representations (INRs), which maps spatial coordinates to corresponding spectral radiance values using a continuous function. The model combines hypernetworks, convolution networks, and periodic spatial encoding to recover high-frequency details. Experimental results demonstrate competitive reconstruction performance compared to state-of-the-art methods, and an ablation study is conducted to evaluate the individual components of the model.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Engineering, Civil

GridDehazeNet plus : An Enhanced Multi-Scale Network With Intra-Task Knowledge Transfer for Single Image Dehazing

Xiaohong Liu, Zhihao Shi, Zijun Wu, Jun Chen, Guangtao Zhai

Summary: This study proposes an enhanced multi-scale network, GridDehazeNet+, for single image dehazing. The method improves on the traditional Atmosphere Scattering Model and incorporates pre-processing, backbone, and post-processing modules. Domain adaptation and knowledge transfer are used to enhance performance, resulting in superior performance compared to existing methods.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2023)

Article Engineering, Electrical & Electronic

RIS-Aided LDM System: A New Prototype in Broadcasting System

Yizhe Zhang, Wen He, Dazhi He, Yin Xu, Yunfeng Guan, Wenjun Zhang

Summary: In this paper, we proposed the use of reconfigurable intelligent surface (RIS) to improve the reception quality in the LDM system, especially in the edge area. By jointly optimizing power control and pairing mechanism using the convex-concave procedure, we addressed the problem of maximizing the minimum SINR. We also explored the high-mobility scenario and used Brownian Motion to model terminal positions and improve the successful reception probability.

IEEE TRANSACTIONS ON BROADCASTING (2023)

Article Computer Science, Artificial Intelligence

Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptation

Shanyan Guan, Jingwei Xu, Michelle Zhang He, Yunbo Wang, Bingbing Ni, Xiaokang Yang

Summary: This research discusses the problem of adapting a human mesh reconstruction model to different domain videos. It proposes an online adaptation method to gradually correct the model bias. The challenges include the lack of 3D annotations and the difficulty of balancing regular frames and hard samples with occlusions or dramatic changes.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2023)

Article Computer Science, Artificial Intelligence

Combinatorial Learning of Robust Deep Graph Matching: An Embedding Based Approach

Runzhong Wang, Junchi Yan, Xiaokang Yang

Summary: This paper utilizes deep neural networks to learn node and edge features, as well as an affinity model for graph matching. The approach is flexible, capable of handling varying numbers of nodes, and shows state-of-the-art performance on extensive benchmarks.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2023)

Article Computer Science, Artificial Intelligence

Learning Multi-Attention Context Graph for Group-Based Re-Identification

Yichao Yan, Jie Qin, Bingbing Ni, Jiaxin Chen, Li Liu, Fan Zhu, Wei-Shi Zheng, Xiaokang Yang, Ling Shao

Summary: This paper introduces the importance of learning to re-identify or retrieve a group of people across non-overlapped camera systems in video surveillance. A novel unified framework based on graph neural networks is proposed to simultaneously address group re-id and group-aware person re-id tasks. The framework constructs a context graph to exploit dependencies among group members and utilizes multi-level attention mechanism and self-attention module to extract robust graph-level representations for both tasks.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2023)

Article Chemistry, Analytical

Image Quality Assessment for Realistic Zoom Photos

Zongxi Han, Yutao Liu, Rong Xie, Guangtao Zhai

Summary: This paper reports the dominance of user-generated content in our lives over traditional DSLRs due to new CMOS imaging sensor (CIS) techniques in smartphones. However, zoom photos captured with tiny sensor sizes and fixed focal lengths tend to have grainy details and zigzag textures due to multi-frame stacking and post-sharpening algorithms. To address this issue, a real-world zoom photo database is constructed, and a novel no-reference zoom quality metric that combines sharpness estimation and image naturalness is proposed. Experimental results show that this quality metric outperforms general-purpose and sharpness models in terms of SROCC and PLCC.

SENSORS (2023)

Article Electrochemistry

In situ synthesis of HCNFs@SnS2 composite via solid-phase vulcanization reaction for high-performance anode of lithium-ion batteries

Wenjun Zhang, Yongzhong Jin, Zhengquan Zhang, Ge Chen, Dongwei Jiang

Summary: In this study, a two-step method was used to prepare a composite anode material consisting of SnS2 nanoparticles and helical carbon nanofibers. The composite anode exhibited superior reversible discharge specific capacity, higher capacity retention rate, and excellent ultra-long cycle capacity. The outstanding electrochemical performance was attributed to the synergistic contribution between the helical carbon nanofibers and SnS2.

ELECTROCHIMICA ACTA (2023)

Article Engineering, Electrical & Electronic

A DRL-Based Joint Scheduling and Resource Allocation Scheme for Mixed Unicast-Broadcast Transmission in 5G

Xiaowu Ou, Yin Xu, Hanjiang Hong, Dazhi He, Yiyan Wu, Yihang Huang, Wenjun Zhang

Summary: With the increasing demand for data services, the spectrum has become a valuable resource. The cooperative transmission mechanism, which allows broadcast and unicast to share the same spectrum, can effectively alleviate this issue. A flexible LDM scheme with a variable power injection ratio is proposed to further improve radio resource utilization. Through a DRL-based algorithm, the optimal scheduling scheme is obtained, and the Lyapunov optimization method is applied to convert the problem to a more conducive form for the agent to learn the optimal strategy. Simulation results show significant improvement in system throughput while ensuring the quality of the broadcast service.

IEEE TRANSACTIONS ON BROADCASTING (2023)

Article Computer Science, Artificial Intelligence

Neural Architecture Selection as a Nash Equilibrium With Batch Entanglement

Qian Li, Chao Xue, Mingming Li, Chun-Guang Li, Chao Ma, Xiaokang Yang

Summary: Proposed a novel approach to discretize and select a proper single-path architecture by formulating it as an architecture game and extracting the architecture with the maximal Nash equilibrium coefficient. Also employed a mini-batch entanglement mechanism based on Gaussian representation to improve efficiency.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

CLSA: A Contrastive Learning Framework With Selective Aggregation for Video Rescaling

Yuan Tian, Yichao Yan, Guangtao Zhai, Li Chen, Zhiyong Gao

Summary: The proposed framework, CLSA, for video rescaling addresses the challenges of information loss and local information aggregation by introducing a contrastive learning framework and a selective global aggregation module. Experimental results demonstrate that CLSA achieves state-of-the-art performance on five datasets.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2023)

Article Computer Science, Information Systems

Blind Image Quality Assessment via Cross-View Consistency

Yucheng Zhu, Yunhao Li, Wei Sun, Xiongkuo Min, Guangtao Zhai, Xiaokang Yang

Summary: Image quality assessment is crucial for both end-users and service-providers, and a new blind image quality assessment model is proposed in this study, which includes self-supervised feature learning and self-attention-based feature fusion to achieve remarkable assessment results on in-the-wild images.

IEEE TRANSACTIONS ON MULTIMEDIA (2023)

Article Computer Science, Information Systems

RIVIE: Robust Inherent Video Information Embedding

Jun Jia, Zhongpai Gao, Dandan Zhu, Xiongkuo Min, Menghan Hu, Guangtao Zhai

Summary: This paper proposes a deep learning-based method for hiding information in videos and transmitting it from screens to cameras while maintaining visual quality. By training a spatio-temporal generator using simulated data and using a distortion network to simulate real-world imaging, the hidden information in videos can be extracted by cameras without impacting the visual quality. This method has the potential for wide application in fields such as advertisement, entertainment, and education.

IEEE TRANSACTIONS ON MULTIMEDIA (2023)

Article Computer Science, Information Systems

Auto-Weighted Layer Representation Based View Synthesis Distortion Estimation for 3-D Video Coding

Jian Jin, Xingxing Zhang, Lili Meng, Weisi Lin, Jie Liang, Huaxiang Zhang, Yao Zhao

Summary: In this paper, an auto-weighted layer representation based view synthesis distortion estimation model is proposed, which calculates sub-synthesis distortion and learns a nonlinear mapping function to obtain the associated weights. It can efficiently and accurately estimate the view synthesis distortion.

IEEE TRANSACTIONS ON MULTIMEDIA (2023)

Article Computer Science, Information Systems

Interaction-Matrix Based Personalized Image Aesthetics Assessment

Jingwen Hou, Weisi Lin, Guanghui Yue, Weide Liu, Baoquan Zhao

Summary: Personalized image aesthetics assessment aims to estimate aesthetic experiences based on individual preferences. This research proposes a method that directly estimates personalized aesthetic experiences from the interaction between image contents and user preferences, without the need for prior knowledge on generic aesthetics assessment. Extensive experiments show that the proposed method outperforms previous personalized methods and generic methods in terms of both personalized and generic aesthetics assessment.

IEEE TRANSACTIONS ON MULTIMEDIA (2023)

No Data Available