4.5 Article

Lasso Meets Horseshoe: A Survey

期刊

STATISTICAL SCIENCE
卷 34, 期 3, 页码 405-427

出版社

INST MATHEMATICAL STATISTICS-IMS
DOI: 10.1214/19-STS700

关键词

Global-local priors; horseshoe; horseshoe; hyper-parameter tuning; Lasso; regression; regularization; sparsity

资金

  1. NSF [DMS-1613063]

向作者/读者索取更多资源

The goal of this paper is to contrast and survey the major advances in two of the most commonly used high-dimensional techniques, namely, the Lasso and horseshoe regularization. Lasso is a gold standard for predictor selection while horseshoe is a state-of-the-art Bayesian estimator for sparse signals. Lasso is fast and scalable and uses convex optimization whilst the horseshoe is nonconvex. Our novel perspective focuses on three aspects: (i) theoretical optimality in high-dimensional inference for the Gaussian sparse model and beyond, (ii) efficiency and scalability of computation and (iii) methodological development and performance.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.5
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Behavioral Sciences

Distance metrics optimized for clustering temporal dietary patterning among US adults

Heather A. Eicher-Miller, Saul Gelfand, Youngha Hwang, Edward Delp, Anindya Bhadra, Jiaqi Guo

APPETITE (2020)

Article Statistics & Probability

Horseshoe Regularisation for Machine Learning in Complex and Deep Models

Anindya Bhadra, Jyotishka Datta, Yunfan Li, Nicholas G. Polson

INTERNATIONAL STATISTICAL REVIEW (2020)

Article Nutrition & Dietetics

Total Usual Micronutrient Intakes Compared to the Dietary Reference Intakes among US Adults by Food Security Status

Alexandra E. Cowan, Shinyoung Jun, Janet A. Tooze, Heather A. Eicher-Miller, Kevin W. Dodd, Jaime J. Gahche, Patricia M. Guenther, Johanna T. Dwyer, Nancy Potischman, Anindya Bhadra, Regan L. Bailey

NUTRIENTS (2020)

Review Nutrition & Dietetics

The Effect of Timing of Exercise and Eating on Postprandial Response in Adults: A Systematic Review

Marah Aqeel, Anna Forster, Elizabeth A. Richards, Erin Hennessy, Bethany McGowan, Anindya Bhadra, Jiaqi Guo, Saul Gelfand, Edward Delp, Heather A. Eicher-Miller

NUTRIENTS (2020)

Article Statistics & Probability

Joint mean-covariance estimation via the horseshoe

Yunfan Li, Jyotishka Datta, Bruce A. Craig, Anindya Bhadra

Summary: Seemingly unrelated regression is a flexible framework for regressing multiple correlated responses on multiple predictors. The use of horseshoe priors on both the mean vector and the inverse covariance matrix addresses the challenges of inferring both parameters simultaneously in a Bayesian framework.

JOURNAL OF MULTIVARIATE ANALYSIS (2021)

Article Mathematical & Computational Biology

Extending the susceptible-exposed-infected-removed (SEIR) model to handle the false negative rate and symptom-based administration of COVID-19 diagnostic tests: SEIR-fansy

Ritwik Bhaduri, Ritoban Kundu, Soumik Purkayastha, Michael Kleinsasser, Lauren J. Beesley, Bhramar Mukherjee, Jyotishka Datta

Summary: The study suggests that considering false negative rates of diagnostic tests for severe acute respiratory coronavirus 2 and selection bias due to prioritized testing, and extending the widely used SEIR model can improve the accuracy of COVID-19 transmission dynamics modeling. Analyzing data from the first two waves of the pandemic in India, the study provides estimates of undetected infections and deaths, and demonstrates the impact of misclassification and selection on future infection prediction and R0 estimation.

STATISTICS IN MEDICINE (2022)

Article Computer Science, Information Systems

Quantifying the Effect of Socio-Economic Predictors and the Built Environment on Mental Health Events in Little Rock, AR

Alfieri Ek, Grant Drawve, Samantha Robinson, Jyotishka Datta

Summary: Law enforcement agencies are increasingly using spatial analysis to identify patterns of outcomes. However, there has been little progress in the statistical modeling of mental health events in Little Rock, Arkansas. In this article, insights into the spatial nature of mental health data from 2015 to 2018 in Little Rock, Arkansas are provided. Different models are used and their relative predictive performances are presented. The findings have the potential to assist law enforcement agencies and the city in resource allocation.

ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION (2023)

Article Biodiversity Conservation

Poison ivy (Toxicodendron radicans) leaf shape variability: Why plant avoidance-by-identification recommendations likely do not substantially reduce poison ivy rash incidence

John G. Jelesko, Kyla Thompson, Noah Magerkorth, Elizabeth Verteramo, Hannah Becker, Joy G. Flowers, Jonathan Sachs, Jyotishka Datta, Jordan Metzgar

Summary: Urushiol, produced by poison ivy, causes millions of cases of delayed contact allergenic dermatitis in North America annually. Avoiding poison ivy plant material is recommended to prevent symptoms. However, the variable leaf shape of poison ivy makes accurate identification difficult.

PLANTS PEOPLE PLANET (2023)

Article Engineering, Electrical & Electronic

A Laplace Mixture Representation of the Horseshoe and Some Implications

Ksheera Sagar, Anindya Bhadra

Summary: The horseshoe prior, a state of the art approach to Bayesian sparse signal recovery, is defined as a half Cauchy scale mixture of normal. In this study, we provide a new representation of the horseshoe density as a scale mixture of the Laplace density, explicitly identifying the mixing measure. The complete monotonicity of the horseshoe density and the strong concavity of the corresponding penalty are established, using the Bernstein-Widder theorem and a result due to Bochner. Moreover, the equivalence between local linear approximation and expectation-maximization algorithms for finding the posterior mode under the horseshoe penalized regression is proven, and the resultant estimate is shown to be sparse.

IEEE SIGNAL PROCESSING LETTERS (2022)

Article Criminology & Penology

Current and New Frontiers: Exploring How Place Matters Through Arkansas NIBRS Reporting Practices

Grant Drawve, Casey T. Harris, Shaun A. Thomas, Jyotishka Datta, Jack Cothren

Summary: This study focuses on criminal incidents reported to the National Incident Based Reporting System in Arkansas in 2016, aiming to showcase the benefits of collecting address-identified NIBRS data for Arkansas and other states. By comparing statewide NIBRS data with address-level data for a specific city, the study illustrates spatial variation in crime occurrence at different levels of analysis.

CRIME & DELINQUENCY (2021)

Article Statistics & Probability

The Horseshoe-Like Regularization for Feature Subset Selection

Anindya Bhadra, Jyotishka Datta, Nicholas G. Polson, Brandon T. Willard

Summary: This paper introduces an alternative method for feature subset selection called the horseshoe regularization penalty, which shows superior theoretical and computational performance compared to existing methods. The distinguishing feature is the probabilistic representation of the penalty, enabling efficient optimization algorithms and uncertainty quantification.

SANKHYA-SERIES B-APPLIED AND INTERDISCIPLINARY STATISTICS (2021)

Proceedings Paper Computer Science, Artificial Intelligence

FairMixRep : Self-supervised Robust Representation Learning for Heterogeneous Data with Fairness constraints

Souradip Chakraborty, Ekansh Verma, Saswata Sahoo, Jyotishka Datta

20TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW 2020) (2020)

Article Statistics & Probability

Global-Local Mixtures: A Unifying Framework

Anindya Bhadra, Jyotishka Datta, Nicholas G. Poison, Brandon T. Willard

SANKHYA-SERIES A-MATHEMATICAL STATISTICS AND PROBABILITY (2020)

暂无数据