OpenFrontiers
← Back to the index

Bayesian Regularization · 2010-stat-9

Nonparametric Inference · ICM 2010: Bayesian Regularization

Inferred from the community field; finer classification has not been reviewed.

Source assessment · not reviewedAs of 2026-08-18Source & evidence ↓

Problem statement

Let d≥1d\ge 1. Let W=(Wt:t∈Rd)W=(W_t:t\in\mathbb R^d) be a centered stationary Gaussian random field with covariance

E[WsWt]=exp⁡(−∥s−t∥2), \mathbb E[W_sW_t]=\exp(-\lVert s-t\rVert^2),

and let A>0A>0 be independent of WW, with AdA^d having a fixed Gamma distribution. On densities on [0,1]d[0,1]^d, consider the prior induced by

fW,A(t)=exp⁡(WAt)∫[0,1]dexp⁡(WAs) ds. f_{W,A}(t)=\frac{\exp(W_{At})}{\int_{[0,1]^d}\exp(W_{As})\,ds}.

Given i.i.d. observations X1,…,XnX_1,\dots,X_n from a continuous density f0f_0 that is bounded away from zero and satisfies log⁡f0∈Cα([0,1]d)\log f_0\in C^\alpha([0,1]^d) for some α>0\alpha>0, call a sequence εn↓0\varepsilon_n\downarrow0 a posterior contraction rate in Hellinger distance if, for every sufficiently large constant MM,

Π ⁣(f:h(f,f0)≥Mεn∣X1,…,Xn)⟶0 \Pi\!\left(f:h(f,f_0)\ge M\varepsilon_n\mid X_1,\dots,X_n\right)\longrightarrow0

in Pf0P_{f_0}-probability. The known upper bound is

εn=n−α/(2α+d)(log⁡n)(4α+d)/(4α+2d). \varepsilon_n=n^{-\alpha/(2\alpha+d)}(\log n)^{(4\alpha+d)/(4\alpha+2d)}.

Determine the sharp posterior contraction rate for this fixed hierarchical prior over α\alpha-Hölder log-densities. In particular, prove or disprove that the minimax Hölder rate n−α/(2α+d)n^{-\alpha/(2\alpha+d)} is unattainable for this prior without a nonconstant logarithmic loss, and determine the optimal exponent of log⁡n\log n if such a loss is unavoidable.

Lean 4

Not yet attached

No Lean statement or proof is attached yet. Have a formalization? Share its source to add it to this problem.

Remaining questions in this record

Remaining questions recorded by the source

These are retained within the parent record and are not counted as additional index entries.

Question 1

Let d≥1d\ge 1, let W=(Wt:t∈Rd)W=(W_t:t\in\mathbb R^d) be a centered stationary Gaussian random field with covariance E[WsWt]=exp⁡(−∥s−t∥2)\mathbb E[W_sW_t]=\exp(-\lVert s-t\rVert^2), and let A>0A>0 be independent of WW, with AdA^d having a fixed Gamma distribution. Put on densities on [0,1]d[0,1]^d the prior induced by

fW,A(t)=exp⁡(WAt)∫[0,1]dexp⁡(WAs) ds. f_{W,A}(t)=\frac{\exp(W_{At})}{\int_{[0,1]^d}\exp(W_{As})\,ds}.

For i.i.d. observations from a continuous density f0f_0 bounded away from zero with log⁡f0∈Cα([0,1]d)\log f_0\in C^\alpha([0,1]^d), determine the optimal exponent β=β(α,d)\beta=\beta(\alpha,d) for which the posterior contracts in Hellinger distance at rate

n−α/(2α+d)(log⁡n)β. n^{-\alpha/(2\alpha+d)}(\log n)^\beta.

In particular, determine whether the known exponent β=(4α+d)/(4α+2d)\beta=(4\alpha+d)/(4\alpha+2d) can be decreased.

Source reference: Aad W. van der Vaart and J. Harry van Zanten, “Adaptive Bayesian Estimation Using a Gaussian Random Field with Inverse Gamma Bandwidth,” The Annals of Statistics 37(5B) (2009), 2655–2675, discussion following Theorem 2.1. DOI: 10.1214/08-AOS678; arXiv:0908.3556.

Progress & source assessment

Source-reported assessment from the ICM catalogue snapshot. This is not an independent review by Frontier Science.

The exact problem remains unresolved as of July 31, 2026. The literature proves the displayed upper bound for the hierarchical squared-exponential prior, but I found no citable result proving a matching lower bound, proving that every achievable rate must contain a divergent logarithmic factor, or identifying the optimal logarithmic exponent for density estimation over Hölder log-densities.

  • Aad W. van der Vaart and J. Harry van Zanten, “Adaptive Bayesian Estimation Using a Gaussian Random Field with Inverse Gamma Bandwidth,” The Annals of Statistics 37(5B), 2009, 2655–2675. DOI: 10.1214/08-AOS678; arXiv:0908.3556. Theorem 2.1 proves contraction in Hellinger distance at n−α/(2α+d)(log⁡n)(4α+d)/(4α+2d)n^{-\alpha/(2\alpha+d)}(\log n)^{(4\alpha+d)/(4\alpha+2d)} for the exact prior and density model in the statement. The discussion immediately after the theorem explicitly conjectures that some logarithmic factor is necessary and says that the displayed exponent may be nonoptimal; it supplies no lower bound.

  • Aad W. van der Vaart and J. Harry van Zanten, “Information Rates of Nonparametric Gaussian Process Methods,” Journal of Machine Learning Research 12, 2011, 2095–2119. Direct URL: https://www.jmlr.org/papers/v12/vandervaart11a.html. Theorem 8 gives a genuine slow-rate lower bound for an unrescaled, fixed squared-exponential Gaussian-process prior in Gaussian regression. It does not apply to the non-Gaussian scale mixture obtained by assigning the inverse-Gamma bandwidth prior, and it does not concern logistic Gaussian-process density estimation. Thus it establishes that lower bounds can be sharp in a related oversmoothing problem but does not resolve the stated conjecture.

  • Amine Hadji and Botond Szabó, “Can We Trust Bayesian Uncertainty Quantification from Gaussian Process Priors with Squared Exponential Covariance Kernel?”, SIAM/ASA Journal on Uncertainty Quantification 9(1), 2021, 185–230. DOI: 10.1137/19M1253010; arXiv:1904.01383. Appendix Theorem A.5 proves an adaptive contraction upper bound, up to logarithmic factors, for a hierarchical approximately squared-exponential sequence prior in the Gaussian white-noise model. Its principal lower/negative results concern frequentist coverage of credible sets, not the sharp contraction rate of the exact density prior in the statement.

  • Xiao Fang and Anindya Bhadra, “Posterior Concentration for Gaussian Process Priors under Rescaled and Hierarchical Matérn and Confluent Hypergeometric Covariance Functions,” Electronic Journal of Statistics 19(2), 2025. DOI: 10.1214/25-EJS2417; arXiv:2312.07502. Theorems 3.10–3.13 obtain exact minimax contraction without a logarithmic loss for hierarchical Matérn and confluent-hypergeometric priors in fixed-design regression. The paper contrasts these finite-smoothness priors with the hierarchical squared-exponential prior, for which it continues to cite only the older “up to a logarithmic factor” rate. Because the covariance family and statistical model differ, these results do not answer the stated density-estimation problem.

Established progress therefore consists of the original near-minimax upper bound and sharp or exact results for neighboring priors and observation models. The missing step is a lower bound for the exact inverse-Gamma-rescaled squared-exponential density prior that either forces a positive logarithmic loss and determines its sharp exponent, or a proof that the logarithm can be removed or improved.

References
  1. [1]ICM Conjectures · 2010-stat-9 link
  2. [2]ICM 2010: Bayesian Regularization link

Recorded progress

Add yours →

Nothing recorded yet. A pointer to a paper the entry is missing counts.

Machine attempts

0 recorded

Attempts run against the statement below and are recorded in full, including the failures. The point is to stop the next model — and the next person — from re-walking a road that is already known to end. Each attempt costs 25 credits.

No machine attempts recorded.

Sign in to run an attempt. New accounts start with enough credits for ten.

Discussion

0 notes

Notes are for clarifying the statement, flagging a missing reference, or recording why an approach fails. Claimed solutions belong in a submission, where they can be reviewed.

No notes yet.

Sign in to add a note.