4.7 Article

On convergence of iterative projection methods for symmetric eigenvalue problems

Journal

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS
Volume 311, Issue -, Pages 513-521

Publisher

ELSEVIER
DOI: 10.1016/j.cam.2016.08.035

Keywords

Iterative methods for eigenvalue problems; Global convergence; Rayleigh-Ritz procedure; Restarting; Preconditioning

Funding

  1. JSPS [25790096]
  2. Grants-in-Aid for Scientific Research [25790096, 17H02826] Funding Source: KAKEN

Ask authors/readers for more resources

We prove global convergence of particular iterative projection methods using the so-called shift-and-invert technique for solving symmetric generalized eigenvalue problems. In particular, we aim to provide a variant of the convergence theorem obtained by Crouzeix, Philippe, and Sadkane for the generalized Davidson method. Our result covers the Jacobi-Davidson and the rational Krylov methods with restarting and preconditioning that are important techniques for modern eigensolvers. More specifically, we prove that the Ritz pairs converge to exact eigenpairs, even though they are not necessarily the target eigenpairs. We would like to emphasize that our proof is not a routine consideration of Crouzeix, Philippe, and Sadkane. To complete the proof, we discover a key lemma, which leads to a very simple convergence proof, resulting in a new theorem similar to that of Crouzeix, Philippe, and Sadkane. (C) 2016 Elsevier B.V. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Mathematics, Applied

Iterative refinement for symmetric eigenvalue decomposition

Takeshi Ogita, Kensuke Aishima

JAPAN JOURNAL OF INDUSTRIAL AND APPLIED MATHEMATICS (2018)

Article Mathematics, Applied

A quadratically convergent algorithm for inverse eigenvalue problems with multiple eigenvalues

Kensuke Aishima

LINEAR ALGEBRA AND ITS APPLICATIONS (2018)

Article Mathematics, Applied

A quadratically convergent algorithm based on matrix equations for inverse eigenvalue problems

Kensuke Aishima

LINEAR ALGEBRA AND ITS APPLICATIONS (2018)

Article Mathematics, Applied

Iterative refinement for symmetric eigenvalue decomposition II: clustered eigenvalues

Takeshi Ogita, Kensuke Aishima

JAPAN JOURNAL OF INDUSTRIAL AND APPLIED MATHEMATICS (2019)

Article Mathematics, Applied

Iterative refinement for singular value decomposition based on matrix multiplication

Takeshi Ogita, Kensuke Aishima

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2020)

Article Mathematics, Applied

Convergence proof of the Harmonic Ritz pairs of iterative projection methods with restart strategies for symmetric eigenvalue problems

Kensuke Aishima

JAPAN JOURNAL OF INDUSTRIAL AND APPLIED MATHEMATICS (2020)

Article Mathematics, Applied

A quadratically convergent algorithm for inverse generalized eigenvalue problems

Kensuke Aishima

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2020)

Article Mathematics, Applied

Statistical modeling and an adaptive averaging technique for strong convergence of the dynamic mode decomposition

Kensuke Aishima

Summary: Dynamic mode decomposition (DMD) is an efficient analysis method for time series data. This study introduces an adaptive averaging technique to DMD for strong convergence in the statistical sense under a newly constructed noise model. The averaging technique can be generally applied to the new noise model as a preconditioning step, and it is proven that the estimator of the original DMD is inconsistent in the statistical sense.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2023)

Article Mathematics, Applied

Strong consistency of the projected total least squares dynamic mode decomposition for datasets with random noise

Kensuke Aishima

Summary: This paper focuses on the statistical consistency analysis of the total least squares DMD (TLS-DMD) method, which is known for its robustness in handling random noise in time series data. By providing a statistical model and a general framework for designing projection methods based on efficient dimensionality reduction, the strong consistency of the estimation is proven.

JAPAN JOURNAL OF INDUSTRIAL AND APPLIED MATHEMATICS (2023)

Article Mathematics, Applied

Consistent estimation for an errors-in-variables model based on constrained total least squares problems

Kensuke Aishima

Summary: This paper constructs a natural errors-in-variables regression model with linear equations constraints and proves the strong consistency of the estimation for the total least squares (TLS) problem. The presented asymptotic theory in the statistical sense is a generalization of the consistency analysis using ordinary total least squares for basic errors-in-variables regression models.

JSIAM LETTERS (2022)

Article Mathematics, Interdisciplinary Applications

Formulations and theorems of quadratically convergent methods for inverse symmetric eigenvalue problems

Kensuke Aishima

IEICE NONLINEAR THEORY AND ITS APPLICATIONS (2020)

Article Mathematics, Applied

Extension of an error analysis of the randomized Kaczmarz method for inconsistent linear systems

Yushi Morijiri, Kensuke Aishima, Takayasu Matsuo

JSIAM LETTERS (2018)

Article Mathematics, Applied

Travelling wave solutions for a Zakharov-Kuznetsov modified equal width equations

M. S. Bruzon, T. M. Garrido, R. de la Rosa

Summary: We study a family of generalized Zakharov-Kuznetsov modified equal width equations in (2+1)-dimensions involving an arbitrary function and three parameters. By using the Lie group theory, we classify the Lie point symmetries of these equations and obtain exact solutions. We also show that this family of equations admits local low-order multipliers and derive all local low-order conservation laws through the multiplier approach.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2024)

Article Mathematics, Applied

A general approach for improving the Pade iterations for the matrix sign function

Dohee Jung, Changbum Chun

Summary: The paper presents a general approach to enhance the Pade iterations for computing the matrix sign function by selecting an arbitrary three-point family of methods based on weight functions. The approach leads to a multi-parameter family of iterations and allows for the discovery of new methods. Convergence and stability analysis as well as numerical experiments confirm the improved performance of the new methods.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2024)

Article Mathematics, Applied

Error analysis of a residual-based Galerkin's method for a system of Cauchy singular integral equations with vanishing endpoint conditions

Abhishek Yadav, Amit Setia, M. Thamban Nair

Summary: In this paper, we propose a Galerkin's residual-based numerical scheme for solving a system of Cauchy-type singular integral equations using Chebyshev polynomials. We prove the well-posedness of the system and derive a theoretical error bound and convergence order. The numerical examples validate the theoretical results.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2024)

Article Mathematics, Applied

Rough set decision algorithms for modeling with uncertainty

Fernando Chacon-Gomez, M. Eugenia Cornejo, Jesus Medina, Eloisa Ramirez-Poussa

Summary: The use of decision rules allows for reliable extraction of information and inference of conclusions from relational databases, but the concepts of decision algorithms need to be extended in fuzzy environments.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2024)

Article Mathematics, Applied

Numerical solution of linear pseudo-parabolic equation with time delay using three layer difference method

Ilhame Amirali, Gabil M. Amiraliyev

Summary: This paper considers the one-dimensional initial-boundary problem for a pseudoparabolic equation with a time delay. To solve this problem numerically, a higher-order difference method is constructed and the error estimate for its solution is obtained. Based on the method of energy estimates, the fully discrete scheme is shown to be convergent of order four in space and of order two in time. The given numerical results illustrate the convergence and effectiveness of the numerical method.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2024)

Article Mathematics, Applied

Solution set bounds for LCPs over tensor spaces

Tong-tong Shang, Guo-ji Tang, Wen-sheng Jia

Summary: The goal of this paper is to investigate a class of linear complementarity problems over tensor-spaces, denoted by TLCP, which is an extension of the classical linear complementarity problem. First, two classes of structured tensors over tensor-spaces (i.e., T-R tensor and T-RO tensor) are introduced and some equivalent characterizations are discussed. Then, the lower bound and upper bound of the solutions in the sense of the infinity norm of the TLCP are obtained when the problem has a solution.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2024)

Article Mathematics, Applied

Existence, uniqueness and approximation of solutions to Caratheodory delay differential equations

Fabio Difonzo, Pawel Przybylowicz, Yue Wu

Summary: This paper focuses on the existence, uniqueness, and approximation of solutions of delay differential equations (DDEs) with Caratheodory type right-hand side functions. It presents the construction of the randomized Euler scheme for DDEs and investigates its error. Furthermore, the paper reports the results of numerical experiments.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2024)

Article Mathematics, Applied

Gradient-based descent linesearch to solve interval-valued optimization problems under gH-differentiability with application to finance

Priyanka Roy, Geetanjali Panda, Dong Qiu

Summary: In this article, a gradient based descent line search scheme is proposed for solving interval optimization problems under generalized Hukuhara differentiability. The innovation and importance of these concepts are presented from practical and computational perspectives. The necessary condition for existence of critical point is presented in inclusion form of interval-valued gradient. Suitable efficient descent direction is chosen based on the monotonic property of the interval-valued function and specific interval ordering. Mathematical convergence of the scheme is proved under the assumption of Inexact line search. The theoretical developments are implemented with a set of interval test problems in different dimensions. A possible application in finance is provided and solved by the proposed scheme.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2024)

Article Mathematics, Applied

A multiscale method for inhomogeneous elastic problems with high contrast coefficients

Zhongqian Wang, Changqing Ye, Eric T. Chung

Summary: In this paper, the constrained energy minimizing generalized multiscale finite element method (CEM-GMsFEM) with mixed boundary conditions for elasticity equations in high contrast media is developed. The method offers advantages such as independence of target region's contrast from precision and significant impact of oversampling domain sizes on numerical accuracy. Furthermore, this is the first proof of convergence of CEM-GMsFEM with mixed boundary conditions for elasticity equations. Numerical experiments demonstrate the method's performance.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2024)

Article Mathematics, Applied

A collocation method using generalized Laguerre polynomials for solving nonlinear optimal control problems governed by integro-differential equations

Samaneh Soradi-Zeid, Maryam Alipour

Summary: The Laguerre polynomials are a new set of basic functions used to solve a specific class of optimal control problems specified by integro-differential equations, namely IOCP. The corresponding operational matrices of derivatives are calculated to extend the solution of the problem in terms of Laguerre polynomials. By considering the basis functions and using the collocation method, the IOCP is simplified into solving a system of nonlinear algebraic equations. The proposed method has been proven to have an error bound and convergence analysis for the approximate optimal value of the performance index. Finally, examples are provided to demonstrate the validity and applicability of this technique.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2024)

Article Mathematics, Applied

Conservation laws, symmetries, and line solitons of a Kawahara-KP equation

Almudena P. Marquez, Maria L. Gandarias, Stephen C. Anco

Summary: A generalization of the KP equation involving higher-order dispersion is studied. The Lie point symmetries and conservation laws of the equation are obtained using Noether's theorem and the introduction of a potential. Sech-type line wave solutions are found and their features, including dark solitary waves on varying backgrounds, are discussed.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2024)

Article Mathematics, Applied

Parameterized transformations and truncation: When is the result a copula?

Susanne Saminger-Platz, Anna Kolesarova, Adam Seliga, Radko Mesiar, Erich Peter Klement

Summary: In this article, we study real functions defined on the unit square satisfying basic properties and explore the conditions for generating bivariate copulas using parameterized transformations and other constructions.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2024)

Article Mathematics, Applied

Maximum-principle-preserving high-order discontinuous Galerkin methods for incompressible Euler equations on overlapping meshes

Lulu Tian, Nattaporn Chuenjarern, Hui Guo, Yang Yang

Summary: In this paper, a new local discontinuous Galerkin (LDG) algorithm is proposed to solve the incompressible Euler equation in two dimensions on overlapping meshes. The algorithm solves the vorticity, velocity field, and potential function on different meshes. The method employs overlapping meshes to ensure continuity of velocity along the interfaces of the primitive meshes, allowing for the application of upwind fluxes. The article introduces two sufficient conditions to maintain the maximum principle of vorticity.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2024)

Article Mathematics, Applied

Convergence analysis of a temporally second-order accurate finite element scheme for the Cahn-Hilliard-Magnetohydrodynamics system of equations

Cheng Wang, Jilu Wang, Steven M. Wise, Zeyu Xia, Liwei Xu

Summary: In this paper, a temporally second-order accurate numerical scheme for the Cahn-Hilliard-Magnetohydrodynamics system of equations is proposed and analyzed. The scheme utilizes a modified Crank-Nicolson-type approximation for time discretization and a mixed finite element method for spatial discretization. The modified Crank-Nicolson approximation allows for mass conservation and energy stability analysis. Error estimates are derived for the phase field, velocity, and magnetic fields, and numerical examples are presented to validate the proposed scheme's theoretical results.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2024)

Article Mathematics, Applied

A compact ADI finite difference method for 2D reaction-diffusion equations with variable diffusion coefficients

Mingyu He, Wenyuan Liao

Summary: This paper presents a numerical method for solving reaction-diffusion equations in spatially heterogeneous domains, which are commonly used to model biological applications. The method utilizes a fourth-order compact alternative directional implicit scheme based on Pade approximation-based operator splitting techniques. Stability analysis shows that the method is unconditionally stable, and numerical examples demonstrate its high efficiency and high order accuracy in both space and time.

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS (2024)