4.2 Article

Bayesian estimation of ridge parameter under different loss functions

期刊

COMMUNICATIONS IN STATISTICS-THEORY AND METHODS
卷 51, 期 12, 页码 4055-4071

出版社

TAYLOR & FRANCIS INC
DOI: 10.1080/03610926.2020.1809675

关键词

BRREs; loss functions; maximum likelihood estimator; mean squared error; posterior distribution; ridge parameters

向作者/读者索取更多资源

In this study, new Bayesian ridge parameters are proposed to address the issue of multicollinearity in linear regression modeling. Simulation and real application results show that these new ridge parameters outperform other loss functions as well as the MLE and ordinary ridge regression estimator, particularly under the Precautionary loss function.
In linear regression modeling, the presence of multicollinearity among the explanatory variables has undesirable effects on the maximum likelihood estimator (MLE). To overcome this effect, we proposed some new ridge parameters under Bayesian paradigm. Moreover, we also compare these ridge parameters with Bayesian approach under different loss functions. To access the performance of new ridge parameters, we conduct a Monte Carlo simulation study where mean squared error (MSE) is considered as an evaluation criterion. In addition, a real life example is also provided to assess the superiority of the proposed estimators on the basis of MSE and cross-validation approaches. The simulation and real application results show that the Bayesian ridge parameter estimated under Precautionary loss function is better as compared to the other loss functions as well as the MLE and ordinary ridge regression estimator.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.2
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Statistics & Probability

On the estimation of Bell regression model using ridge estimator

Muhammad Amin, Muhammad Nauman Akram, Abdul Majid

COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION (2023)

Article Statistics & Probability

On the generalized biased estimators for the gamma regression model: methods and applications

Muhammad Nauman Akram, Muhammad Amin, Muhammad Faisal

Summary: This study proposes a generalized class of biased estimators for addressing the multicollinearity problem in gamma regression models. Through simulation and empirical applications, it is found that the generalized gamma ridge regression estimator outperforms MLE and generalized gamma Liu estimator.

COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION (2023)

Article Statistics & Probability

New robust ridge estimators for the linear regression model with outliers

Abdul Majid, Muhammad Amin, Muhammad Aslam, Shakeel Ahmad

Summary: The ridge regression estimator is widely used in multiple linear regression models, but it may have adverse effects when outliers are present. To address this, robust ridge estimators based on M-estimator are proposed, which are less sensitive to outliers. This study introduces robust ridge estimators for the ridge parameter and evaluates their performance through simulations and a real application. The results show that the proposed robust ridge estimators outperform the traditional methods in terms of mean squared error.

COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION (2023)

Article Mathematics

K-L Estimator: Dealing with Multicollinearity in the Logistic Regression Model

Adewale F. F. Lukman, B. M. Golam Kibria, Cosmas K. K. Nziku, Muhammad Amin, Emmanuel T. T. Adewuyi, Rasha Farghali

Summary: The Logistic Kibria-Lukman estimator (LKLE) is proposed to handle multicollinearity in the logistic regression model. The superiority condition of this new estimator over other methods is theoretically established and validated using real-life data and simulation. The performance of the estimators is contingent on the adopted shrinkage parameter estimators.

MATHEMATICS (2023)

Article Statistics & Probability

Modified ridge-type estimator for the zero inflated negative binomial regression model

Muhammad Nauman Akram, Nimra Afzal, Muhammad Amin, Asia Batool

Summary: The ZINB modified ridge type (ZINBMRT) estimator is proposed to address the issue of multicollinearity in the ZINB regression model. New approaches to estimate the shrinkage parameters for the ZINBMRT estimator are also proposed. Simulation and example studies show that the proposed ZINBMRT estimator outperforms other competitive estimators.

COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION (2023)

Article Computer Science, Interdisciplinary Applications

Two parameter estimators for the Conway-Maxwell-Poisson regression model

Faiza Sami, Muhammad Moeen Butt, Muhammad Amin

Summary: The two-parameter estimator (TPE) is proposed for the Poisson regression model, but it has the limitation of a single parameter. The count data models often suffer from the problems of dispersion and multicollinearity. The Conway-Maxwell-Poisson regression model (COMPRM) is suitable for handling both issues simultaneously. To estimate the COMPRM coefficients, the iterative reweighted least square (IRLS) method is used. Through a Monte Carlo simulation study, the efficiency of the estimator is evaluated based on the mean square error (MSE). In the presence of multicollinearity, the Asar and Genc's two-parameter estimator (AGTPE) shows better efficiency for COMPRM compared to other estimators like maximum likelihood (MLE), Ridge estimator, Liu estimator, and the TPE by Huang and Yang (HYTPE). The proposed estimator is also being studied for real-life applications.

JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION (2023)

Article Engineering, Multidisciplinary

On the performance of some new ridge parameter estimators in the Poisson-inverse Gaussian ridge regression

Asia Batool, Muhammad Amin, Ahmed Elhassanein

Summary: The Poisson Inverse Gaussian Regression model (PIGRM) is proposed to model count datasets and address over-dispersion. The maximum likelihood estimator (MLE) is commonly used for PIGRM, but it is not efficient when the explanatory variables are correlated. To overcome this issue, a ridge estimator is proposed and its properties are compared with MLE. Different ridge parameter estimators are also proposed. Simulation and real-life application results demonstrate the superiority of the proposed estimators over MLE using MSE as the performance evaluation criterion.

ALEXANDRIA ENGINEERING JOURNAL (2023)

Article Mathematics

Deviance and Pearson Residuals-Based Control Charts with Different Link Functions for Monitoring Logistic Regression Profiles: An Application to COVID-19 Data

Maryam Cheema, Muhammad Amin, Tahir Mahmood, Muhammad Faisal, Kamel Brahim, Ahmed Elhassanein

Summary: In statistical process control, control charts are used to monitor processes. This study proposes GLM-based control charts using different link functions and a binary response variable. Simulation study and real application on COVID-19 death monitoring demonstrate that the model-based control charts with the c-log-log link function perform better than other link functions.

MATHEMATICS (2023)

Article Mathematics, Applied

James Stein Estimator for the Beta Regression Model with Application to Heat-Treating Test and Body Fat Datasets

Muhammad Amin, Hajra Ashraf, Hassan S. Bakouch, Najla Qarmalah

Summary: This study proposes the James Stein Estimator for the beta regression model to address the issue of inaccurate estimation with correlated explanatory variables. Through simulation experiments and real-life applications, it is found that the proposed estimator outperforms other competitive estimators in estimating the parameters of the beta regression model.

AXIOMS (2023)

Article Mathematics, Applied

On the Estimation of the Binary Response Model

Muhammad Amin, Muhammad Nauman Akram, B. M. Golam Kibria, Huda M. M. Alshanbari, Nahid Fatima, Ahmed Elhassanein

Summary: This study proposed a new adjusted likelihood estimator for addressing the issue of multicollinearity in binary logistic regression models. Through Monte Carlo simulation and real application research, it was found that our proposed estimator performs better when there exists high but imperfect multicollinearity.

AXIOMS (2023)

Article Computer Science, Interdisciplinary Applications

Influential observation detection in the logistic regression under different link functions: an application to urine calcium oxalate crystals data

Muhammad Amin, Azka Fatima, Muhammad Nauman Akram, Mustafa Kamal

Summary: This study compares the performance of different link functions in diagnosing influential observations in the logistic regression model. The results show that the CVR method with the logit link function is good for small explanatory variables. For large explanatory variables and small sample sizes, the cook's distance and DIFFITS with probit and logit link functions perform better than the CVR method. Similarly, for large explanatory variables and sample sizes, the cook's distance (with probit and logit link functions) and CVR with cauchit link function have the same performance and are better than the DFFITS method.

JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION (2023)

Article Multidisciplinary Sciences

An Almost Unbiased Ridge Estimator for the Conway-Maxwell-Poisson Regression Model

Faiza Sami, Muhammad Amin, Muhammad Moeen Butt, Seyab Yasin

Summary: The Poisson model, commonly used for counts type response variables, has a limitation of equal mean and variance compared to the Conway-Maxwell-Poisson-regression model (COMPRM). This study proposes an almost unbiased ridge estimator for the estimation of COMPRM coefficients and derives its theoretical properties. The results show that the proposed estimator outperforms the classical MLE and ridge estimators in terms of the minimum MSE and bias.

IRANIAN JOURNAL OF SCIENCE (2023)

Article Statistics & Probability

Kibria-Lukman estimator for the zero inflated negative binomial regression model: theory, simulation and applications

Muhammad Nauman Akram, Muhammad Amin, Nimra Afzal, B. M. Golam Kibria

Summary: The article discusses the parameter estimation for the zero-inflated negative binomial model in the presence of multicollinearity. A new estimator, called Kibria-Lukman estimator, is proposed along with some biasing parameters. The performance of the proposed estimator is compared with traditional biased estimators and found to be superior.

COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION (2023)

Article Statistics & Probability

Some properties of weighted survival extropy and its extended measures

Siddhartha Chakraborty, Biswabrata Pradhan

Summary: This paper studies some properties of weighted survival extropy measure, introduces weighted extended survival extropy and its dynamic version, and investigates various properties of the proposed measures. Generalized inequalities related to weighted extended survival extropy are also studied. Non-parametric estimators of these measures are proposed and their asymptotic properties are investigated. The performance of the estimators is assessed through a simulation study. Finally, it is shown that the weighted survival extropy measure can be used in model discrimination and as an alternative risk measure.

COMMUNICATIONS IN STATISTICS-THEORY AND METHODS (2024)

Article Statistics & Probability

Stochastic comparisons of linear degradation and failure time models with dependent failure modes

Xiaoliang Ling, Jiaojiao Zhang, Yinzhao Wei

Summary: This paper considers a reliability model for systems that fail due to degradation failure or catastrophic failure. The degradation process is modeled using a linear degradation path, and the catastrophic failure rate is dependent on the degradation rate. Firstly, stochastic comparisons are conducted between two systems with different stochastic orders for their respective degradation rate variables. Secondly, stochastic comparisons are conducted between two systems with different conditional catastrophic failure rates. Finally, examples are given using well-known models to demonstrate the validity of the results.

COMMUNICATIONS IN STATISTICS-THEORY AND METHODS (2024)

Article Statistics & Probability

L0-regularization for high-dimensional regression with corrupted data

Jie Zhang, Yang Li, Ni Zhao, Zemin Zheng

Summary: This article discusses the widespread issue of corrupted data in many contemporary applications. It proposes a sparse modeling method based on L-0 regularization and efficiently solves the regularization problem using projection techniques. It proves the statistical properties of the proposed method under certain conditions and demonstrates its effectiveness through simulation studies.

COMMUNICATIONS IN STATISTICS-THEORY AND METHODS (2024)

Article Statistics & Probability

Improving estimation efficiency for multivariate failure time data with auxiliary covariates

Lin Zhu, Feifei Yan

Summary: An estimated quadratic inference function method is developed for the analysis of multivariate failure time data, where the primary covariates are incomplete but the auxiliary covariates for them are available for the whole cohort subjects. This method improves the estimation efficiency under the marginal hazard model with common baseline hazard function by incorporating both the auxiliary information and the intra-cluster correlation between the failure times. Simulation studies demonstrate that the proposed method gains noticeable efficiency compared to other existing methods when the intra-cluster correlation is strong or moderate.

COMMUNICATIONS IN STATISTICS-THEORY AND METHODS (2024)

Article Statistics & Probability

On reliability analysis in k-out-of-n systems under Archimedean copula dependence

Longxiang Fang, Shuai Zhang, Jinling Lu

Summary: This paper investigates the k-out-of-n system with n independent parallel subsystems comprising dependent components drawn from a heterogeneous population consisting of m different subpopulations. The components within each subpopulation are assumed to be dependent, while the subpopulations are independent of each other. The study discusses the reliability of the k-out-of-n systems by comparing two selection probabilities or two allocation policies in the sense of majorization order. Numerical examples are provided to illustrate the obtained results. Finally, some concluding remarks are made.

COMMUNICATIONS IN STATISTICS-THEORY AND METHODS (2024)

Article Statistics & Probability

Estimation in nonlinear random fields models of autoregressive type with random parameters

Amel Saidi, Abdelghani Hamaz, Ouerdia Arezki

Summary: This article presents new theoretical results on estimation in nonlinear random field models. The authors focus on a two dimensionally indexed random coefficients autoregressive model and develop a maximum likelihood estimation procedure for estimating the unknown parameters. The authors also prove the strong consistency of the estimates. The results are applied to construct efficient estimates in a specific model.

COMMUNICATIONS IN STATISTICS-THEORY AND METHODS (2024)

Article Statistics & Probability

Robust optimal proportional reinsurance and investment problem for an insurer with delay and dependent risks

Qiang Zhang, Lijun Wu

Summary: In this article, a robust optimal proportional reinsurance and investment problem is considered in a model with delay and dependent risks. The insurer aims to develop the optimal strategy by maximizing the expected exponential utility of the combination of historical performance and terminal wealth. The expressions of the optimal strategy and value function are explicitly obtained using stochastic dynamic programming technique.

COMMUNICATIONS IN STATISTICS-THEORY AND METHODS (2024)

Article Statistics & Probability

Design and implementation of distribution-free Phase-II charting schemes based on unconditional run-length percentiles

Jean-Claude Malela-Majika, Marien A. Graham

Summary: This study explores the idea of designing nonparametric charting schemes by using lower percentile points of the unconditional run-length distribution to restrict the probability of unconditional early false alarms. The research indicates that bias in the Phase-I sample may lead to remarkably high rates of early false alarms.

COMMUNICATIONS IN STATISTICS-THEORY AND METHODS (2024)

Letter Statistics & Probability

Remark on a further remark on the alternative expectation formula

Reza Farhadian

COMMUNICATIONS IN STATISTICS-THEORY AND METHODS (2024)

Article Statistics & Probability

Permutation confidence region for multiple regression and fidelity to asymptotic approximation

Qiang Wu, Paul Vos

Summary: The article introduces the application of permutation inference distribution in multiple regression, which can be used for hypothesis testing and confidence interval construction with relatively low computational burden. The results show that PID confidence regions are asymptotically ellipsoidal and exact.

COMMUNICATIONS IN STATISTICS-THEORY AND METHODS (2024)