4.6 Review

A Comprehensive Review on Content-Aware Image Retargeting: From Classical to State-of-the-art Methods

Journal

SIGNAL PROCESSING
Volume 195, Issue -, Pages -

Publisher

ELSEVIER
DOI: 10.1016/j.sigpro.2022.108496

Keywords

Content-aware image retargeting; Image quality assessment; Image resizing; CAIR

Ask authors/readers for more resources

This paper provides a general classification and detailed discussion of Content-Aware Image Retargeting (CAIR) techniques, introduces existing benchmark datasets, and qualitatively evaluates the performance of CAIR methods on these datasets. It also introduces Retargeted Image Quality Assessment (RIQA) metrics for quantitative evaluation of CAIR techniques. Different RIQA metrics are compared to determine their effectiveness in evaluating CAIR methods. The primary purpose of this paper is to provide a comprehensive understanding of CAIR and RIQA techniques and discuss the advantages and disadvantages of each method.
Content-Aware Image Retargeting (CAIR) techniques are important in multimedia applications for displaying images on various display devices. This paper first provides a general classification of CAIR methods and then discusses them in more detail. In addition, the existing benchmark datasets are introduced, and the performance of CAIR approaches on the images of these datasets is qualitatively evaluated. Furthermore, Retargeted Image Quality Assessment (RIQA) metrics are introduced to quantitative evaluation of CAIR techniques. Finally, different RIQA metrics are compared to determine which can effectively evaluate the CAIR methods. In general, the primary purpose of this paper is to provide a comprehensive perspective of CAIR and RIQA techniques and to discuss the advantages and disadvantages of each method.(c) 2022 Elsevier B.V. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Interdisciplinary Applications

UFS-Net: A unified flame and smoke detection method for early detection of fire in video surveillance applications using CNNs

Ali Hosseini, Mahdi Hashemzadeh, Nacer Farajzadeh

Summary: Fire is a recurring event that causes significant damage in various environments, making machine vision-based fire detection an important task. In this research, a unified flame and smoke detection approach called UFS-Net, based on deep learning, is proposed. UFS-Net can classify video frames into eight classes to identify fire hazards and achieve high performance through extensive experiments and comparisons with state-of-the-art methods.

JOURNAL OF COMPUTATIONAL SCIENCE (2022)

Article Computer Science, Artificial Intelligence

Smoke detection in video using convolutional neural networks and efficient spatio-temporal features

Mahdi Hashemzadeh, Nacer Farajzadeh, Milad Heydari

Summary: Early detection of fire, particularly smoke, is crucial in various environmental applications. Traditional machine learning approaches and deep learning-based methods have limitations in terms of transparency of smoke and motion characteristics. This study introduces a hybrid approach based on deep learning, spatio, and spatio-temporal characteristics to accurately detect smoke. The proposed method achieves high performance and accuracy in experiments, outperforming competitors in terms of false alarm rate.

APPLIED SOFT COMPUTING (2022)

Article Biology

A fully-convolutional residual encoder-decoder neural network to localize breast cancer on histopathology images

Nacer Farajzadeh, Nima Sadeghzadeh, Mahdi Hashemzadeh

Summary: Early cancer detection is crucial for effective treatment and recovery. This study proposes a method to mask cancerous nuclei in histopathology images, making them easily distinguishable by experts. The proposed method achieves high accuracy in quantitative and qualitative evaluations.

COMPUTERS IN BIOLOGY AND MEDICINE (2022)

Article Computer Science, Information Systems

A geometric-based clustering method using natural neighbors

Shahin Pourbahrami, Mahdi Hashemzadeh

Summary: In this paper, a geometric-based clustering method is proposed which utilizes the concept of natural neighborhoods to extract the local density of data points. The algorithm forms primary clusters, extracts the heads of the clusters, and identifies weak or noise data points by recognizing points with a low number of natural neighbors. The desired clusters are obtained by disregarding the weak/noise points.

INFORMATION SCIENCES (2022)

Article Computer Science, Artificial Intelligence

QDL-CMFD: A Quality-independent and deep Learning-based Copy- Move image forgery detection method

Mehrad Aria, Mahdi Hashemzadeh, Nacer Farajzadeh

Summary: This study presents an image forgery detection method called QDL-CMFD, which is based on deep learning. QDL-CMFD utilizes generative adversarial networks for image quality enhancement and convolutional neural networks for forgery detection. Unlike existing methods, QDL-CMFD is able to simultaneously detect multiple forged areas and determine the source and target of the forgery. Experimental results demonstrate its excellent performance in detecting low-quality forged images and small areas.

NEUROCOMPUTING (2022)

Article Computer Science, Interdisciplinary Applications

ACQC: Apollonius Circle-based Quantum Clustering

Nasim Abdolmaleki, Leyli Mohammad Khanli, Mahdi Hashemzadeh, Shahin Pourbahrami

Summary: This paper introduces an Apollonius Circle-based Quantum Clustering (ACQC) method, which adaptively sets the kernel bandwidth without prior knowledge, resulting in improved accuracy and efficiency in clustering.

JOURNAL OF COMPUTATIONAL SCIENCE (2022)

Article Computer Science, Cybernetics

PMG-Net: Persian music genre classification using deep neural networks

Nacer Farajzadeh, Nima Sadeghzadeh, Mahdi Hashemzadeh

Summary: Music genres are important tools for organizing music and targeting different markets. This research introduces a new deep neural network-based method for automatically classifying Persian music genres, which shows acceptable accuracy in the dataset test.

ENTERTAINMENT COMPUTING (2022)

Article Computer Science, Artificial Intelligence

FoodRecNet: a comprehensively personalized food recommender system using deep neural networks

Saeed Hamdollahi Oskouei, Mahdi Hashemzadeh

Summary: In order to choose appropriate food based on people's preferences, an intelligent system is needed. This study presents a deep learning-based food recommender system called FoodRecNet, which utilizes various characteristics and features of users and foods. A large annotated dataset is created to evaluate the system, and experiments confirm its effectiveness. The implementation source codes and datasets of this research are publicly available.

KNOWLEDGE AND INFORMATION SYSTEMS (2023)

Article Engineering, Biomedical

IJES-OA Net: A residual neural network to classify knee osteoarthritis from radiographic images based on the edges of the intra-joint spaces

Nacer Farajzadeh, Nima Sadeghzadeh, Mahdi Hashemzadeh

Summary: Osteoarthritis is the most common musculoskeletal disorder worldwide, particularly in the knee joint. Accurate diagnosis of osteoarthritis has been challenging due to the low quality and indistinctness of clinical radiographic images. This research proposes a deep residual neural network named IJES-OA Net, which focuses on the distance of the bone edges inside the knee joint to automatically grade the severity of knee osteoarthritis via radiographs. Experimental results demonstrate that IJES-OA Net achieves high accuracy and precision with less complexity compared to other methods, and the generated attention maps enhance experts' reliance on the results.

MEDICAL ENGINEERING & PHYSICS (2023)

Article Computer Science, Artificial Intelligence

Brain tumor segmentation and classification on MRI via deep hybrid representation learning

Nacer Farajzadeh, Nima Sadeghzadeh, Mahdi Hashemzadeh

Summary: Detecting brain tumors is crucial for patients' survival, and Magnetic Resonance Imaging (MRI) has been proven to be the most accurate method. However, the accuracy of evaluation by human specialists can be compromised due to fatigue, lack of expertise, and insufficiency of information in the images. This study proposes a segmentation approach to assist specialists in accurately detecting brain tumors, achieving the highest accuracy compared to previous studies.

EXPERT SYSTEMS WITH APPLICATIONS (2023)

Article Computer Science, Artificial Intelligence

Addressing the class-imbalance and class-overlap problems by a metaheuristic-based under-sampling approach

Paria Soltanzadeh, M. Reza Feizi-Derakhshi, Mahdi Hashemzadeh

Summary: This research proposes an under-sampling approach based on a metaheuristic method to address the problems of imbalanced class distribution and class overlap, achieving significant performance improvement compared to competitors.

PATTERN RECOGNITION (2023)

Article Computer Science, Artificial Intelligence

DiagCovidPNA: diagnosing and differentiating COVID-19, viral and bacterial pneumonia from chest X-ray images using a hybrid specialized deep learning approach

Vahid Mohammadian Takaloo, Mahdi Hashemzadeh, Jalil Ghavidel Neycharan

Summary: In this study, a method called DiagCovidPNA is proposed to diagnose and differentiate COVID-19 disease and viral and bacterial pneumonia (PNA) from chest X-ray (CXR) images. The method is based on application-specific convolutional neural networks (CNNs) and offers two different systems: DiagCovidPNA and Hybrid DiagCovidPNA. Extensive experiments were conducted to evaluate both systems, and the results showed that the diagnostic accuracy of DiagCovidPNA and Hybrid DiagCovidPNA is 95% and 97.50% respectively. Hybrid DiagCovidPNA improves accuracy by approximately 8% compared to other deep learning-based methods with the same structure. All implementation source codes and the compiled CXR database are publicly available.

SOFT COMPUTING (2023)

Article Computer Science, Software Engineering

CGFFCM: A color image segmentation method based on cluster-weight and feature-weight learning

Amin Golzari Oskouei, Mahdi Hashemzadeh

Summary: CGFFCM is a clustering-based color image segmentation approach that mitigates initialization sensitivity through an automatic cluster weighting strategy, improves clustering accuracy using a group-local feature weighting technique, and enhances image segmentation quality by combining image features from different groups.

SOFTWARE IMPACTS (2022)

Article Engineering, Electrical & Electronic

Robust registration and learning using multi-radii spherical polar Fourier transform

Alam Abbas Syed, Hassan Foroosh

Summary: This paper presents effective methods using spherical polar Fourier transform data for two different applications: 3D volumetric registration and machine learning classification network. The proposed method for registration offers unique and effective techniques, handling arbitrary large rotation angles and showing robustness. The modified classification network achieves robust classification results in processing spherical data.

SIGNAL PROCESSING (2024)

Article Engineering, Electrical & Electronic

TVRPCA plus : Low-rank and sparse decomposition based on spectral norm and structural sparsity-inducing norm

Ruibo Fan, Mingli Jing, Jingang Shi, Lan Li, Zizhao Wang

Summary: In this study, a new low-rank sparse decomposition algorithm named TVRPCA+ is proposed for foreground-background separation. The algorithm combines spectral norm, structured sparse norm, and total variation regularization to suppress noise and obtain cleaner foregrounds. Experimental results demonstrate that TVRPCA+ achieves high performance in complex backgrounds and noise scenarios.

SIGNAL PROCESSING (2024)

Article Engineering, Electrical & Electronic

LFM signal parameter estimation in the fractional Fourier domains: Analytical models and a high-performance algorithm

Omair Aldimashki, Ahmet Serbes

Summary: This paper proposes a coarse-to-fine FrFT-based algorithm for chirp-rate estimation of multi-component LFM signals, which achieves improved performance and a reduced signal-to-noise breakdown threshold by utilizing mathematical models for coarse estimation and a refined estimate-and-subtract strategy. Extensive simulation results demonstrate that the proposed algorithm performs very close to the Cramer-Rao lower bound, with the advantages of eliminating leakage effect, avoiding error propagation, and maintaining acceptable computational cost compared to other state-of-the-art methods.

SIGNAL PROCESSING (2024)

Article Engineering, Electrical & Electronic

Multiple sources localization with 2D-DFT under distributed massive antenna arrays

Xinlei Shi, Xiaofei Zhang, Yuxin Sun, Yang Qian, Jinke Cao

Summary: In this paper, a low-complexity localization approach for multiple sources using two-dimensional discrete Fourier transform (2D-DFT) is proposed. The method computes the cross-covariance and utilizes phase offset method and total least square solution to obtain accurate position estimates.

SIGNAL PROCESSING (2024)

Article Engineering, Electrical & Electronic

Extended target tracking under multitarget tracking framework for convex polytope shapes

Prabhanjan Mannari, Ratnasingham Tharmarasa, Thiagalingam Kirubarajan

Summary: This paper discusses the problem of extended target tracking for a single 2D extended target with a known convex polytope shape and dynamics. It proposes a framework based on the existing point multitarget tracking framework to address the challenges of uncertainty in shape and kinematics, as well as self-occlusion. The algorithm developed using this framework is capable of dynamically changing the number of parameters used to describe the shape and estimating the whole target shape even when different parts of the target are visible at different frames.

SIGNAL PROCESSING (2024)

Article Engineering, Electrical & Electronic

Robust small infrared target detection using weighted adaptive ring top-hat transformation

Yongsong Li, Zhengzhou Li, Jie Li, Junchao Yang, Abubakar Siddique

Summary: This paper proposes a weighted adaptive ring top-hat transformation (WARTH) for extracting infrared small targets in complex backgrounds. The WARTH method effectively measures local and global feature information using an adaptive ring-shaped structural element and a target awareness indicator, resulting in accurate detection of small targets with minimized false alarms.

SIGNAL PROCESSING (2024)

Article Engineering, Electrical & Electronic

Variable step-size convex regularized PRLS algorithms

Yu Wang, Zhen Qin, Jun Tao, Yili Xia

Summary: In this paper, an enhanced sparsity-aware recursive least squares (RLS) algorithm is proposed, which combines the proportionate updating (PU) and zero-attracting (ZA) mechanisms, and introduces a general convex regularization (CR) function and variable step-size (VSS) technique to improve performance.

SIGNAL PROCESSING (2024)

Article Engineering, Electrical & Electronic

Analysis of the Least Mean Square algorithm with processing delays in the adaptive arm for Gaussian inputs for system identification

Neil J. Bershad, Jose C. M. Bermudez

Summary: This paper analyzes the impact of processing delay on the Least Mean Squares (LMS) algorithm in system identification, highlighting bias issues in the resulting weight vector.

SIGNAL PROCESSING (2024)

Article Engineering, Electrical & Electronic

A single dwell velocity estimation method for pulse Doppler radar using multicarrier signals

Kanghui Jiang, Defu Jiang, Mingxing Fu, Yan Han, Song Wang, Chao Zhang, Jingyu Shi

Summary: In this paper, a novel method for velocity estimation using multicarrier signals in a single dwell is proposed, which effectively addresses the issue of Doppler ambiguity in pulse Doppler radars.

SIGNAL PROCESSING (2024)

Article Engineering, Electrical & Electronic

Long-time adaptive coherent detection of small targets in sea clutter by fast inversion algorithm of block tridiagonal speckle covariance matrices

Xiao-Jun Zhang, Peng-Lang Shui, Yu-Fan Xue

Summary: This paper proposes a method for low-velocity small target detection in maritime surveillance radars. It models sea clutter sequences using the spherical invariant random vector (SIRV) model with block tridiagonal speckle covariance matrix and inverse Gamma distributed texture. The proposed detector, which is a long-time adaptive generalized likelihood ratio test with linear threshold detector (GLRT-LTD), shows competitive detection performance in experiments.

SIGNAL PROCESSING (2024)

Article Engineering, Electrical & Electronic

Adaptive weighted robust data recovery with total variation for hyperspectral image

Aiyi Zhang, Fulai Liu, Ruiyan Du

Summary: This paper proposes an adaptive weighted robust data recovery method with total variation regularization for hyperspectral image. The method models the HSI recovery problem as a tensor robust principal component analysis optimization problem, decomposing the data into low-rank HSI data, outliers, and noise component. An adaptive weighted strategy is then defined to impose on the tensor nuclear norm and outliers, using the priori information of singular values and strengthening the sparsity of outliers.

SIGNAL PROCESSING (2024)

Article Engineering, Electrical & Electronic

Model order estimation based on the correntropy of observation eigenvalues

Hamid Asadi, Babak Seyfe

Summary: This paper presents a novel approach for estimating the model order in the presence of observation errors. The proposed method is based on correntropy estimation of eigenvalues in the observation space, which is further enhanced by resampling the observations using the bootstrap method. The algorithm partitions the observation space into signal and noise subspaces using the covariance matrix of mixtures, and determines the model order based on a correntropy estimator with kernel functions. Theoretical analysis and comparative evaluations demonstrate the superiority of this information-theoretic approach.

SIGNAL PROCESSING (2024)

Article Engineering, Electrical & Electronic

A novel family of online censoring based complex-valued least mean kurtosis algorithms

Buket colak Guvenc, Engin Cemal Menguc

Summary: In this paper, a novel family of online censoring based complex-valued least mean kurtosis (CLMK) algorithms is proposed. The algorithms censor less informative complex-valued data streams and reduce the costs of data processing without affecting accuracy. Robust algorithms are also developed to handle outliers. The simulation results confirm the attractive features of the proposed algorithms in large-scale system identification and regression scenarios.

SIGNAL PROCESSING (2024)

Article Engineering, Electrical & Electronic

Enhancing concealed object detection in Active Millimeter Wave Images using wavelet transform

Yun Su, Weixian Tan, Yifan Dong, Wei Xu, Pingping Huang, Jianxin Zhang, Diankun Zhang

Summary: In this study, a novel method for detecting low-resolution and small targets in millimeter wave radar images is proposed. The Wavelet-Conv structure and Wavelet-Attention mechanism are introduced to overcome the limitations of existing detectors. Experimental results demonstrate that the proposed method improves recall and mean average precision while maintaining competitive inference speed.

SIGNAL PROCESSING (2024)

Article Engineering, Electrical & Electronic

Spectral structure inducing efficient variational model for enhancing bearing fault feature

Xin Wang, Xingxing Jiang, Qiuyu Song, Jie Liu, Jianfeng Guo, Zhongkui Zhu

Summary: This study proposes a variational mode extraction (VME) method for extracting specific modes from complicated signals. By exploring the convergence property of VME, strategies for identifying ICF and determining the balance parameter are designed, and a bandwidth estimation strategy is constructed. The effectiveness of the proposed method for bearings fault diagnosis is verified and compared with other methods.

SIGNAL PROCESSING (2024)