4.7 Article

Cartoon-Texture Image Decomposition Using Blockwise Low-Rank Texture Characterization

Journal

IEEE TRANSACTIONS ON IMAGE PROCESSING
Volume 23, Issue 3, Pages -

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TIP.2014.2299067

Keywords

Cartoon-texture decomposition; convex optimization; image restoration; low-rank interpretation; texture characterization

Funding

  1. JSPS [24.2522, B-21300091]
  2. Grants-in-Aid for Scientific Research [21300091, 24560443] Funding Source: KAKEN

Ask authors/readers for more resources

Using a novel characterization of texture, we propose an image decomposition technique that can effectively decomposes an image into its cartoon and texture components. The characterization rests on our observation that the texture component enjoys a blockwise low-rank nature with possible overlap and shear, because texture, in general, is globally dissimilar but locally well patterned. More specifically, one can observe that any local block of the texture component consists of only a few individual patterns. Based on this premise, we first introduce a new convex prior, named the block nuclear norm (BNN), leading to a suitable characterization of the texture component. We then formulate a cartoon-texture decomposition model as a convex optimization problem, where the simultaneous estimation of the cartoon and texture components from a given image or degraded observation is executed by minimizing the total variation and BNN. In addition, patterns of texture extending in different directions are extracted separately, which is a special feature of the proposed model and of benefit to texture analysis and other applications. Furthermore, the model can handle various types of degradation occurring in image processing, including blur + missing pixels with several types of noise. By rewriting the problem via variable splitting, the so-called alternating direction method of multipliers becomes applicable, resulting in an efficient algorithmic solution to the problem. Numerical examples illustrate that the proposed model is very selective to patterns of texture, which makes it produce better results than state-of-the-art decomposition models.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Proceedings Paper Acoustics

Operator-Norm-Based Variable-Wise Diagonal Preconditioning for Automatic Stepsize Selection of A Primal-Dual Splitting Algorithm

Kazuki Naganuma, Shunsuke Ono

Summary: We propose a diagonal preconditioning method for automatically selecting the step sizes of a primal-dual splitting method. This method resolves the limitations of the conventional method and establishes a practical preconditioning method. The proposed preconditioners eliminate the need for the matrix representations of linear operators and allow for computable proximity operators.

2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022) (2022)

Article Geochemistry & Geophysics

Robust Hyperspectral Image Fusion With Simultaneous Guide Image Denoising via Constrained Convex Optimization

Saori Takeyama, Shunsuke Ono

Summary: This article proposes a new method for estimating high spatial resolution hyperspectral images based on convex optimization. The method can simultaneously estimate a high spatial resolution image and a noiseless guide image, and effectively utilize prior knowledge and spatial detail information to improve the estimation accuracy.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Geochemistry & Geophysics

Graph Spatio-Spectral Total Variation Model for Hyperspectral Image Denoising

Shingo Takemoto, Kazuki Naganuma, Shunsuke Ono

Summary: The spatio-spectral total variation (SSTV) model is widely used for regularization of hyperspectral images (HSIs), but it struggles with removing noise while preserving complex spatial structures. To address this issue, we propose a new regularization method called graph-SSTV (GSSTV), which explicitly reflects the spatial structure of the HSI and incorporates a weighted spatial difference operator. We formulate the noise removal problem as a convex optimization problem involving GSSTV and develop an efficient algorithm to solve it.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2022)

Article Engineering, Electrical & Electronic

Sparsity-Aware OCT Volumetric Data Restoration Using Optical Synthesis Model

Ruiki Kobayashi, Genki Fujii, Yuta Yoshida, Takeru Ota, Fumiaki Nin, Hiroshi Hibino, Samuel Choi, Shunsuke Ono, Shogo Muramatsu

Summary: A novel restoration model is proposed for optical coherence tomography (OCT) data, which tackles the challenge of weak reflected light and identifies tomographic structures using image processing and an algorithm derived from a primal-dual splitting framework. The significance of this method is verified through simulations and experiments, highlighting its importance in restoring OCT data.

IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING (2022)

Article Geochemistry & Geophysics

A General Destriping Framework for Remote Sensing Images Using Flatness Constraint

Kazuki Naganuma, Shunsuke Ono

Summary: This article proposes a general destriping framework using a newly introduced stripe noise characterization named flatness constraint (FC) to handle various image regularizations. The framework formulates the destriping problem as a nonsmooth convex optimization problem involving a general form of image regularization and the FC, effectively removing stripe noise from images by mathematically modeling the constraint.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Proceedings Paper Computer Science, Information Systems

Recovery of Time Series of Graph Signals Over Dynamic Topology

Eisuke Yamagata, Shunsuke Ono

Summary: This paper proposes a novel recovering framework for dynamic graph signal models that leverage both temporal and vertex-domain priors, by introducing regularization terms in a convex optimization problem to capture behaviors of graph signals in the two domains and integrate the dynamics of the dynamic graph topology. Experimental comparisons with conventional frameworks on synthetic datasets demonstrate the advantageous results of the proposed method in numerous settings.

2021 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC) (2021)

Proceedings Paper Acoustics

ZERO-GRADIENT CONSTRAINTS FOR DESTRIPING OF REMOTE-SENSING DATA

Kazuki Naganuma, Saori Takeyama, Shunsuke Ono

Summary: This paper introduces an effective destriping method for remote-sensing data by formulating the problem as a convex optimization problem with zero-gradient constraints. The method fully captures the nature of stripe noise and utilizes a simple operation to develop an efficient algorithm for solving the problem. The advantages of the method are demonstrated through destriping experiments using remote-sensing data.

2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021) (2021)

Proceedings Paper Acoustics

DESIGN OF GRAPH SIGNAL SAMPLING MATRICES FOR ARBITRARY SIGNAL SUBSPACES

Junya Hara, Koki Yamada, Shunsuke Ono, Yuichi Tanaka

Summary: This paper proposes a design method for sampling matrices of graph signals that ensures perfect recovery for arbitrary graph signal subspaces. Experimental results show that the proposed sampling matrix provides better reconstruction accuracy for various signal models.

2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021) (2021)

Article Engineering, Electrical & Electronic

Data-Driven Sparse Sensor Selection Based on A-Optimal Design of Experiment With ADMM

Takayuki Nagata, Taku Nonomura, Kumi Nakai, Keigo Yamada, Yuji Saito, Shunsuke Ono

Summary: This study proposes a sensor selection method based on the proximal splitting algorithm and the ADMM algorithm, showing better performance than existing greedy and convex relaxation methods in terms of the A-optimality criterion. The proposed method requires longer computational time than the greedy method but is shorter than the convex relaxation method in large-scale problems.

IEEE SENSORS JOURNAL (2021)

Article Engineering, Electrical & Electronic

Epigraphical Relaxation for Minimizing Layered Mixed Norms

Seisuke Kyochi, Shunsuke Ono, Ivan Selesnick

Summary: This paper introduces an epigraphical relaxation (ERx) technique for non-proximable mixed norm minimization, providing a method to handle a wide range of non-proximable mixed norms in optimization without changing the minimizer of the original problem. Additionally, novel regularizers based on ERx are developed and shown to be effective through experiments.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2021)

Proceedings Paper Acoustics

Robust Acoustic Scene Classification to Multiple Devices Using Maximum Classifier Discrepancy and Knowledge Distillation

Saori Takeyama, Tatsuya Komatsu, Koichi Miyazaki, Masahito Togami, Shunsuke Ono

Summary: This paper proposes a robust acoustic scene classification (ASC) method for multiple devices using maximum classifier discrepancy (MCD) and knowledge distillation (KD), which employs domain adaptation to train device-specific ASC models and combines them into a multi-domain ASC model. The proposed method aligns class distributions using MCD for domain adaptation and improves ASC accuracy for both target and non-target devices.

28TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2020) (2021)

Article Engineering, Electrical & Electronic

Randomized Subspace Newton Convex Method Applied to Data-Driven Sensor Selection Problem

Taku Nonomura, Shunsuke Ono, Kumi Nakai, Yuji Saito

Summary: This study proposes randomized subspace Newton convex methods for sensor selection problem, where a customized approach is used to select update variables for improved performance. The results show that the randomized subspace Newton methods yield almost identical results in the converged solution compared to the original method. Furthermore, while requiring more computational steps, the randomized subspace Newton methods reduce total computational time significantly.

IEEE SIGNAL PROCESSING LETTERS (2021)

Proceedings Paper Computer Science, Artificial Intelligence

JOINT MIXED-NOISE REMOVAL AND COMPRESSED SENSING RECONSTRUCTION OF HYPERSPECTRAL IMAGES VIA CONVEX OPTIMIZATION

Saori Takeyama, Shunsuke Ono

IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (2020)

Proceedings Paper Imaging Science & Photographic Technology

COMPRESSED HYPERSPECTRAL PANSHARPENING

Saori Takeyama, Shunsuke Ono

2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) (2020)

Proceedings Paper Acoustics

EPIGRAPHICAL REFORMULATION FOR NON-PROXIMABLE MIXED NORMS

Seisuke Kyochi, Shunsuke Ono, Ivan Selesnick

2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (2020)

No Data Available