4.5 Article

Fast TV Regularization for 2D Maximum Penalized Likelihood Estimation

Journal

JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS
Volume 20, Issue 2, Pages 479-491

Publisher

TAYLOR & FRANCIS INC
DOI: 10.1198/jcgs.2010.09048

Keywords

Crime; Density estimation; Spatial point process; Split Bregman minimization; Total Variation

Funding

  1. ARO MURI [50363-MA-MUR]
  2. NSF [ACI-0321917, BCS-0527388]
  3. ONR [N000140810363, N000141010221]
  4. Department of Defense
  5. Direct For Mathematical & Physical Scien [0968309] Funding Source: National Science Foundation
  6. Division Of Mathematical Sciences [0968309] Funding Source: National Science Foundation

Ask authors/readers for more resources

Total Variation-based regularization, well established for image processing applications such as denoising, was recently introduced for Maximum Penalized Likelihood Estimation (MPLE) as an effective way to estimate nonsmooth probability densities. While the estimates show promise for a variety of applications, the nonlinearity of the regularization leads to computational challenges, especially in multidimensions. In this article we present a numerical methodology, based upon the Split Bregman L1 minimization technique, that overcomes these challenges, allowing for the fast and accurate computation of 2D TV-based MPLE. We test the methodology with several examples, including V-fold cross-validation with large 2D datasets, and highlight the application of TV-based MPLE to point process crime modeling. The proposed algorithm is implemented as the Mat lab function TVMPLE. The Mat lab (mex) code and datasets for examples and simulations are available as online supplements.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Chemistry, Physical

Extraction of Hidden Science from Nanoscale Images

Kristopher K. Barr, Naihao Chiang, Andrea L. Bertozzi, Jerome Gilles, Stanley J. Osher, Paul S. Weiss

Summary: Scanning probe techniques have been enhanced by improving data acquisition and image processing algorithms, enabling more detailed analysis of surfaces and interfaces, including image segmentation by domains, detection of dipole direction, and hydrogen-bonding interactions. The computational algorithms used in these techniques are continually evolving, with the incorporation of machine learning to the next level of iteration. However, real-time adjustments during data recording are still a challenge for significantly enhancing microscopy and spectroscopic imaging methods.

JOURNAL OF PHYSICAL CHEMISTRY C (2022)

Article Chemistry, Multidisciplinary

Suspendable Hydrogel Nanovials for Massively Parallel Single-Cell Functional Analysis and Sorting

Joseph de Rutte, Robert Dimatteo, Maani M. Archang, Mark van Zee, Doyeon Koo, Sohyung Lee, Allison C. Sharrow, Patrick J. Krohl, Michael Mellody, Sheldon Zhu, James Eichenbaum, Monika Kizerwetter, Shreya Udani, Kyung Ha, Richard C. Willson, Andrea L. Bertozzi, Jamie B. Spangler, Robert Damoiseaux, Dino Di Carlo

Summary: Techniques to analyze and sort single cells based on functional outputs have the potential to transform cellular biology and accelerate the development of cell and antibody therapies. This study describes a method to fabricate chemically functionalized microcontainers, called nanovials, for sorting single cells based on their secreted products. The nanovials can be easily used with commonly accessible laboratory infrastructure and allow high-throughput screening of cells.

ACS NANO (2022)

Article Engineering, Multidisciplinary

Surface energy minimizing configurations for axisymmetric microparticles

Kyung Ha, Joseph de Rutte, Dino Di Carlo, Andrea L. Bertozzi

Summary: This paper introduces a new method to create templated droplets using amphiphilic microparticles and presents a mathematical model to explain the key properties of droplet formation.

JOURNAL OF ENGINEERING MATHEMATICS (2022)

Article Computer Science, Artificial Intelligence

Scheduled Restart Momentum for Accelerated Stochastic Gradient Descent

Bao Wang, Tan Nguyen, Tao Sun, Andrea L. Bertozzi, Richard G. Baraniuk, Stanley J. Osher

Summary: This paper proposes a new DNN training scheme called scheduled restart SGD (SRSGD), which replaces the constant momentum in SGD with increasing momentum and stabilizes the iterations by resetting the momentum to zero according to a schedule. Experimental results demonstrate that SRSGD significantly improves the convergence and generalization of DNNs across various models and benchmarks.

SIAM JOURNAL ON IMAGING SCIENCES (2022)

Article Oncology

Post-Radiotherapy PET Image Outcome Prediction by Deep Learning Under Biological Model Guidance: A Feasibility Study of Oropharyngeal Cancer Application

Hangjie Ji, Kyle Lafata, Yvonne Mowery, David Brizel, Andrea L. Bertozzi, Fang-Fang Yin, Chunhao Wang

Summary: A biologically guided deep learning method was developed to predict post-radiation (18)FDG-PET image outcome based on pre-radiation images and radiotherapy dose information. The method incorporates a novel biological model and a 7-layer CNN to generate predicted images with breakdown biological components. The results showed good agreement with ground-truth and can be used for adaptive radiotherapy decision-making.

FRONTIERS IN ONCOLOGY (2022)

Article Mathematics, Applied

Alternative SIAR models for infectious diseases and applications in the study of non-compliance

Marcelo Bongarti, Luke Diego Galvan, Lawford Hatcher, Michael R. Lindstrom, Christian Parkinson, Chuntian Wang, Andrea L. Bertozzi

Summary: In this paper, two ways of understanding and quantifying the effect of non-compliance to non-pharmaceutical intervention measures on the spread of infectious diseases are proposed using modified versions of the SIAR model. The first modification assumes a known proportion of the population does not comply with government mandates, while the second modification treats non-compliant behavior as a social contagion. The paper also explores different scenarios and provides local and asymptotic analyses for both models.

MATHEMATICAL MODELS & METHODS IN APPLIED SCIENCES (2022)

Article Mathematics, Applied

EFFICIENT AND RELIABLE OVERLAY NETWORKS FOR DECENTRALIZED FEDERATED LEARNING\ast

Yifan Hua, Kevin Miller, Andrea L. Bertozzi, Chen Qian, Bao Wang

Summary: This paper proposes near-optimal overlay networks based on d-regular expander graphs for accelerating decentralized federated learning and improving its generalization. By integrating spectral graph theory and the theoretical convergence and generalization bounds for DFL, the proposed overlay networks provide theoretical guarantees for accelerated convergence, improved generalization, and enhanced robustness to client failures in DFL. Additionally, an efficient algorithm is presented to convert a given graph into a practical overlay network and maintain the network topology after potential client failures. Numerical experiments demonstrate the advantages of DFL with the proposed networks on various benchmark tasks involving hundreds of clients.

SIAM JOURNAL ON APPLIED MATHEMATICS (2022)

Article Engineering, Multidisciplinary

Structural Equivalence in Subgraph Matching

Dominic Yang, Yurun Ge, Thien Nguyen, Denali Molitor, Jacob D. Moorman, Andrea L. Bertozzi

Summary: Symmetry is important in subgraph matching and affects both the graph description and the search process. This work quantifies the effects of symmetry and proposes using it to improve subgraph isomorphism algorithms' efficiency. The authors define structural equivalence and establish conditions for safely generating more solutions. They demonstrate how to modify search routines to utilize symmetries and efficiently describe the solution space. The methods are tested on a benchmark set and extended to multiplex graphs with results from transportation systems, social media, adversarial attacks, and knowledge graphs.

IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING (2023)

Article Criminology & Penology

The pandemic did not interrupt LA's violence interrupters

Jiaoying Ren, Karina Santoso, David Hyde, Andrea L. Bertozzi, P. Jeffrey Brantingham

Summary: This paper examines the impact of COVID-19 on the activities of front-line workers in the City of Los Angeles Mayor's Office of Gang Reduction and Youth Development (GRYD), and finds that proactive peacemaking and violence interruption activities either remained stable or increased with the onset of the lockdown. However, the causal connection between these activities and gang-related crime needs further evaluation.

JOURNAL OF AGGRESSION CONFLICT AND PEACE RESEARCH (2023)

Proceedings Paper Computer Science, Artificial Intelligence

Utilizing Contrastive Learning for Graph-Based Active Learning of SAR Data

Jason Brown, Riley O'Neill, Jeff Calder, Andrea L. Bertozzi

Summary: By using data augmentations specific to SAR imagery, this paper develops a contrastive SimCLR framework for feature extraction from MSTAR images. The results show that our contrastive embedding performs better than the autoencoder embedding in automatic target recognition on the MSTAR dataset.

ALGORITHMS FOR SYNTHETIC APERTURE RADAR IMAGERY XXX (2023)

Proceedings Paper Computer Science, Artificial Intelligence

Deep Semi-supervised Label Propagation for SAR Image Classification

Joshua Enwright, Harris Hardiman-Mostow, Jeff Calder, Andrea Bertozzi

Summary: This article introduces two new methods for classifying SAR data. The first method involves using Convolutional Neural Network (CNN) for feature extraction and combining with graph-based semi-supervised learning techniques to improve classification performance in small labeled datasets. The second method involves using Pseudo Label Propagation Neural Networks (PsLaPN Networks) to enhance training signal and address overconfidence and poor model calibration in neural networks. In experiments, both methods outperform the previous state-of-the-art on the OpenSARShip dataset.

ALGORITHMS FOR SYNTHETIC APERTURE RADAR IMAGERY XXX (2023)

Proceedings Paper Acoustics

PRIVACY-PRESERVING FEDERATED MULTI-TASK LINEAR REGRESSION: A ONE-SHOT LINEAR MIXING APPROACH INSPIRED BY GRAPH REGULARIZATION

Harlin Lee, Andrea L. Bertozzi, Jelena Kovacevic, Yuejie Chi

Summary: This study investigates multi-task learning and proposes a fusion framework for federated multi-task linear regression. The proposed method combines local estimates and achieves improved performance in terms of mean squared error. Experimental results show the effectiveness of the method on real-world data.

2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) (2022)

Proceedings Paper Computer Science, Interdisciplinary Applications

Graph-based Active Learning for Semi-supervised Classification of SAR Data

Kevin Miller, Jack Mauro, Jason Setiadi, Xoaquin Baca, Zhan Shi, Jeff Calder, Andrea L. Bertozzi

Summary: The article presents a novel method for classifying Synthetic Aperture Radar (SAR) data using a combination of graph-based learning and neural network methods. The method uses a Convolutional Neural Network Variational Autoencoder (CNNVAE) to embed SAR data into a feature space, and then constructs a similarity graph for classification. The method reduces overfitting and improves generalization performance, and can be easily combined with human-in-the-loop active learning.

ALGORITHMS FOR SYNTHETIC APERTURE RADAR IMAGERY XXIX (2022)

Article Automation & Control Systems

Neural ODE Control for Trajectory Approximation of Continuity Equation

Karthik Elamvazhuthi, Bahman Gharesifard, Andrea L. Bertozzi, Stanley Osher

Summary: The controllability problem of the continuity equation corresponding to neural ordinary differential equations is explored, showing strong controllability properties. Specifically, given solutions of the continuity equation define trajectories on sets of probability measures. The study establishes the approximate controllability of the continuity equation of the neural ODE on sets of compactly supported probability measures.

IEEE CONTROL SYSTEMS LETTERS (2022)

Article Mathematics, Interdisciplinary Applications

A MARTINGALE FORMULATION FOR STOCHASTIC COMPARTMENTAL SUSCEPTIBLE-INFECTED-RECOVERED (SIR) MODELS TO ANALYZE FINITE SIZE EFFECTS IN COVID-19 CASE STUDIES

Xia Li, Chuntian Wang, Hao Li, Andrea L. Bertozzi

Summary: Deterministic compartmental models can provide the mean behavior of stochastic agent-based models, but they may significantly deviate from the mean in finite size populations due to chance variations. In this article, a martingale formulation is derived for the stochastic Susceptible-Infected-Recovered (SIR) model, consisting of a deterministic part coinciding with the classical SIR model and an upper bound for the stochastic part. Theoretical explanation of finite size effects is provided through analysis of the stochastic component depending on varying population size, supported by quantitative and direct numerical simulations.

NETWORKS AND HETEROGENEOUS MEDIA (2022)

No Data Available