Path-following methods for Maximum a Posteriori estimators in Bayesian hierarchical models: How estimates depend on hyperparameters Article Swipe

MAKE IMPACT

Zilai Si , Yucong Liu , Alexander Strang · YOU? · · 2022 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2211.07113

Maximum a posteriori (MAP) estimation, like all Bayesian methods, depends on prior assumptions. These assumptions are often chosen to promote specific features in the recovered estimate. The form of the chosen prior determines the shape of the posterior distribution, thus the behavior of the estimator and complexity of the associated optimization problem. Here, we consider a family of Gaussian hierarchical models with generalized gamma hyperpriors designed to promote sparsity in linear inverse problems. By varying the hyperparameters, we move continuously between priors that act as smoothed $\ell_p$ penalties with flexible $p$, smoothing, and scale. We then introduce a predictor-corrector method that tracks MAP solution paths as the hyperparameters vary. Path following allows a user to explore the space of possible MAP solutions and to test the sensitivity of solutions to changes in the prior assumptions. By tracing paths from a convex region to a non-convex region, the user can find local minimizers in strongly sparsity promoting regimes that are consistent with a convex relaxation derived using related prior assumptions. We show experimentally that these solutions. are less error prone than direct optimization of the non-convex problem.

Type

preprint

Language

en

Landing Page

http://arxiv.org/abs/2211.07113

PDF

https://arxiv.org/pdf/2211.07113

OA Status

green

Cited By

1

Related Works

10

OpenAlex ID

https://openalex.org/W4309133645

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4309133645

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2211.07113

Digital Object Identifier

Title

Path-following methods for Maximum a Posteriori estimators in Bayesian hierarchical models: How estimates depend on hyperparameters

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2022

Year of publication

Publication date

2022-11-14

Full publication date if available

Authors

Zilai Si, Yucong Liu, Alexander Strang

List of authors in order

Landing page

https://arxiv.org/abs/2211.07113

Publisher landing page

PDF URL

https://arxiv.org/pdf/2211.07113

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/2211.07113

Direct OA link when available

Concepts

Hyperparameter, Maximum a posteriori estimation, Prior probability, Mathematical optimization, Estimator, Smoothing, Mathematics, Bayesian probability, Gaussian, Inverse problem, Algorithm, Computer science, Applied mathematics, Statistics, Maximum likelihood, Physics, Quantum mechanics, Mathematical analysis

Top concepts (fields/topics) attached by OpenAlex

Cited by

1

Total citation count in OpenAlex

Citations by year (recent)

2023: 1

Per-year citation counts (last 5 years)

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload