4.7 Article

BLIQUE-TMI: Blind Quality Evaluator for Tone-Mapped Images Based on Local and Global Feature Analyses

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TCSVT.2017.2783938

Keywords

Tone mapping; image quality assessment; sparse representation; visual information; local structure; naturalness; extreme learning machine

Funding

  1. Natural Science Foundation of China [61622109]
  2. Zhejiang Natural Science Foundation [R18F010008]
  3. China Scholarship Council [201708330302]
  4. K. C. Wong Magna Fund of Ningbo University

Ask authors/readers for more resources

High dynamic range (HDR) image, which has a powerful capacity to represent the wide dynamic range of real-world scenes, has been receiving attention from both academic and industrial communities. Although HDR imaging devices have become prevalent, the display devices for HDR images are still limited. To facilitate the visualization of HDR images in standard low dynamic range displays, many different tone mapping operators (TMOs) have been developed. To create a fair comparison of different TMOs, this paper proposes a BLInd QUality Evaluator to blindly predict the quality of Tone-Mapped Images (BLIQUE-TMI) without accessing the corresponding HDR versions. BLIQUE-TMI measures the quality of TMIs by considering the following aspects: 1) visual information; 2) local structure; and 3) naturalness. To be specific, quality-aware features related to the former two aspects are extracted in a local manner based on sparse representation, while quality-aware features related to the third aspect are derived based on global statistics modeling in both intensity and color domains. All the extracted local and global quality-aware features constitute a final feature vector. An emergent machine learning technique, i.e., extreme learning machine, is adopted to learn a quality predictor from feature space to quality space. The superiority of BLIQUE-TMI to several leading blind IQA metrics is well demonstrated on two benchmark databases.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Information Systems

Image Quality Assessment-driven Reinforcement Learning for Mixed Distorted Image Restoration

Xiaoyu Zhang, Wei Gao, Ge Li, Qiuping Jiang, Runmin Cong

Summary: Due to the diverse nature of degradation process, recovery of mixed distorted images remains challenging. Training deep learning models for one degradation type leads to significant decline in performance for other degradation types. In this article, we propose a hierarchical toolkit to address the limitations of a single deep network and explore the use of reinforcement learning for efficient restoration of distorted images. Our method accurately captures distortion preferences and achieves quality improvements through exploration using various evaluation methods. Experimental results show significant improvement in peak signal-to-noise ratio compared to state-of-the-art RL-based methods.

ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS (2023)

Article Engineering, Electrical & Electronic

A Perception-Aware Decomposition and Fusion Framework for Underwater Image Enhancement

Yaozu Kang, Qiuping Jiang, Chongyi Li, Wenqi Ren, Hantao Liu, Pengjun Wang

Summary: This paper proposes a perception-aware decomposition and fusion framework for underwater image enhancement (UIE). Two complementary pre-processed inputs are fused in a perception-aware and conceptually independent image space through a structural patch decomposition and fusion (SPDF) approach. The main advantage of SPDF is that it can fuse different components separately without any interactions and information loss. Comprehensive comparisons demonstrate that SPDF outperforms state-of-the-art UIE algorithms.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY (2023)

Article Computer Science, Artificial Intelligence

Adaptive Context Exploration Network for Polyp Segmentation in Colonoscopy Images

Guanghui Yue, Siying Li, Tianwei Zhou, Miaohui Wang, Jingfeng Du, Qiuping Jiang, Wei Gao, Tianfu Wang, Jun Lv

Summary: Automatic and accurate polyp segmentation is a challenging issue. We construct a benchmark dataset and propose a novel adaptive context exploration network (ACENet) which achieves superior performance on multiple evaluation metrics over state-of-the-art methods.

IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE (2023)

Article Engineering, Electrical & Electronic

DisCoVQA: Temporal Distortion-Content Transformers for Video Quality Assessment

Haoning Wu, Chaofeng Chen, Liang Liao, Jingwen Hou, Wenxiu Sun, Qiong Yan, Weisi Lin

Summary: Compared with existing works, temporal relationships between frames and their influences on video quality assessment (VQA) are relatively under-studied. This study proposes a Transformer-based VQA method to tackle these issues. The method extracts spatial-temporal features and handles temporal quality attention, achieving state-of-the-art performance on multiple benchmarks.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY (2023)

Article Engineering, Electrical & Electronic

Bidirectional Collaborative Mentoring Network for Marine Organism Detection and Beyond

Jinguang Cheng, Zongwei Wu, Shuo Wang, Cedric Demonceaux, Qiuping Jiang

Summary: This article introduces a novel organism detection method called BCMNet, which fully utilizes texture and context clues during the encoding and decoding stages, improving the accuracy of locating the target organism object in marine scenes.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY (2023)

Article Engineering, Electrical & Electronic

Quality Evaluation of Arbitrary Style Transfer: Subjective Study and Objective Metric

Hangwei Chen, Feng Shao, Xiongli Chai, Yuese Gu, Qiuping Jiang, Xiangchao Meng, Yo-Sung Ho

Summary: This paper discusses the important topic of arbitrary neural style transfer, which has significant research value and wide industrial application. The focus is on improving the quality of arbitrary style transfer (AST) and the lack of exploration in quality evaluation of AST images. The paper proposes a new AST images quality assessment database (AST-IQAD) and a sparse representation-based method for measuring the image quality.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY (2023)

Article Engineering, Electrical & Electronic

Real-World Non-Homogeneous Haze Removal by Sliding Self-Attention Wavelet Network

Yuxin Feng, Xiaozhe Meng, Fan Zhou, Weisi Lin, Zhuo Su

Summary: This paper proposes a sliding self-attention wavelet network for image haze removal in complex natural haze scenes. The method uses a sliding self-attention module to identify haze regions and uses discrete wavelet transform and inverse transform to construct a hierarchical encoder-decoder structure for gradually recovering sharp edges and precise texture details. Experimental results demonstrate that the proposed algorithm achieves favorable dehazing performance on relevant benchmark datasets.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY (2023)

Article Computer Science, Artificial Intelligence

Collaborative Learning and Style-Adaptive Pooling Network for Perceptual Evaluation of Arbitrary Style Transfer

Hangwei Chen, Feng Shao, Xiongli Chai, Qiuping Jiang, Xiangchao Meng, Yo-Sung Ho

Summary: In this article, a learnable network named CLSAP-Net is proposed to address the perceptual evaluation issue of arbitrary style transfer (AST) images. The network consists of three parts: content preservation estimation network (CPE-Net), style resemblance estimation network (SRE-Net), and OV target network (OVT-Net). Reliable quality factors are generated using self-attention mechanism and joint regression strategy, and the importance weights of factors are manipulated using a novel style-adaptive pooling strategy. Extensive experiments on existing AST image quality assessment (IQA) databases validate the effectiveness and robustness of CLSAP-Net.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

WaveNet: Wavelet Network With Knowledge Distillation for RGB-T Salient Object Detection

Wujie Zhou, Fan Sun, Qiuping Jiang, Runmin Cong, Jenq-Neng Hwang

Summary: In recent years, various neural network architectures such as the visual transformer and multilayer perceptron (MLP) have been developed for computer vision. The transformer, utilizing an attention mechanism, outperforms traditional convolutional neural networks. The MLP, on the other hand, offers stronger generalization by introducing less inductive bias. However, the transformer suffers from significant increase in inference, training, and debugging times. This article proposes the WaveNet architecture for salient object detection in RGB-thermal infrared images, using a vision task-oriented wavelet-based MLP for feature extraction. The knowledge distillation from a transformer and the use of a Kullback-Leibler distance regularization term are also employed.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2023)

Article Computer Science, Artificial Intelligence

Intrinsic and Isotropic Resampling for 3D Point Clouds

Chenlei Lv, Weisi Lin, Baoquan Zhao

Summary: In this paper, a two-step intrinsic and isotropic (I&I) resampling framework is proposed to address the major difficulties in point cloud utilization. Experimental results demonstrate that our framework achieves outstanding performance in various applications, including point cloud simplification, mesh reconstruction, and shape registration.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2023)

Article Computer Science, Artificial Intelligence

KSS-ICP: Point Cloud Registration Based on Kendall Shape Space

Chenlei Lv, Weisi Lin, Baoquan Zhao

Summary: In this paper, a new registration method called KSS-ICP is proposed for rigid registration in Kendall shape space (KSS) with Iterative Closest Point (ICP). The KSS is a quotient space that removes influences of translations, scales, and rotations for shape feature-based analysis. The KSS-ICP achieves accurate registration from point clouds and outperforms the state-of-the-art.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2023)

Article Computer Science, Information Systems

Auto-Weighted Layer Representation Based View Synthesis Distortion Estimation for 3-D Video Coding

Jian Jin, Xingxing Zhang, Lili Meng, Weisi Lin, Jie Liang, Huaxiang Zhang, Yao Zhao

Summary: In this paper, an auto-weighted layer representation based view synthesis distortion estimation model is proposed, which calculates sub-synthesis distortion and learns a nonlinear mapping function to obtain the associated weights. It can efficiently and accurately estimate the view synthesis distortion.

IEEE TRANSACTIONS ON MULTIMEDIA (2023)

Article Computer Science, Information Systems

Interaction-Matrix Based Personalized Image Aesthetics Assessment

Jingwen Hou, Weisi Lin, Guanghui Yue, Weide Liu, Baoquan Zhao

Summary: Personalized image aesthetics assessment aims to estimate aesthetic experiences based on individual preferences. This research proposes a method that directly estimates personalized aesthetic experiences from the interaction between image contents and user preferences, without the need for prior knowledge on generic aesthetics assessment. Extensive experiments show that the proposed method outperforms previous personalized methods and generic methods in terms of both personalized and generic aesthetics assessment.

IEEE TRANSACTIONS ON MULTIMEDIA (2023)

Article Geochemistry & Geophysics

Uplink-Assist Downlink Remote-Sensing Image Compression via Historical Referencing

Huiwen Wang, Liang Liao, Jing Xiao, Weisi Lin, Mi Wang

Summary: This article proposes an enhanced remote-sensing image compression approach that utilizes uplink assistance to improve compression efficiency. By leveraging historical images from ground stations as reference images for on-orbit compression, spatiotemporal redundancy in remote-sensing images can be effectively eliminated. The proposed dual-end referencing downsampling-based coding framework effectively mitigates fake texture generation and achieves significant bitrate savings compared to standard compression baselines.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Geochemistry & Geophysics

Graph Attention Guidance Network With Knowledge Distillation for Semantic Segmentation of Remote Sensing Images

Wujie Zhou, Xiaomin Fan, Weiqing Yan, Shengdao Shan, Qiuping Jiang, Jenq-Neng Hwang

Summary: In this study, a lightweight student network framework called GAGNet-S* is proposed, which combines graph attention guidance network and knowledge distillation. This framework distills knowledge from a large teacher network and optimizes an untrained student network with weak labels, achieving semantic segmentation of high-resolution remote sensing images with excellent performance.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

No Data Available