ArXiv

Variance or Standard Deviation? Shell Geometry and Global-Scale Priors in High-Dimensional Shrinkage

Authors
Wayne Yuan Gao, Zhiheng You
Categories
stat.ME, econ.EM, stat.ML
arXiv
https://arxiv.org/abs/2606.23509v1
PDF
https://arxiv.org/pdf/2606.23509v1

Brief

High-dimensional Gaussian-shrinkage with a common global scale is analyzed by Wayne Yuan Gao and Zhiheng You (arXiv 2026-06-22). They show that whether a default prior is flat on variance or on standard deviation changes mass near zero and drives first-order differences in shrinkage risk: SD-flat yields a one-unit asymptotic advantage near the origin, crosses in a critical regime, and matches variance-flat for strong signals. Analysis in the abstract only; full text not included here.

Why it matters

Gao & You (published on arXiv 2026-06-22) prove that priors flat on standard deviation (SD-flat) vs priors flat on variance allocate markedly different mass near the zero-scale boundary, producing distinct high-dimensional shrinkage risk behaviors.

Key details

  • Under a radial-power benchmark the SD-flat benchmark attains a one-unit asymptotic risk advantage near the origin, then 'crosses over' in a critical regime and is second-order equivalent to the variance-flat benchmark for strong signals.
  • Proper single global-scale hyperpriors and bounded coordinate-multiplier mixtures inherit these asymptotic limits via the near-zero exponent of their SD-scale density; for heavier-tailed or sparse priors the same exponent classifies the global-scale component while local-scale tails, model-size, or allocation priors can further affect risk.
Source evidence

Abstract

We study how the choice of default prior for a common Gaussian scale affects high-dimensional shrinkage risk, highlighting the role played by high-dimensional geometry. Formally, we consider a high-dimensional setting in which the near-zero behavior of the common scale prior has first-order consequences for shrinkage risk, and show that priors that are flat on the variance and those flat on the standard deviation allocate markedly different mass near the zero-scale boundary, leading to distinct shrinkage behavior and informing principled default prior selection. Specifically, under a radial-power benchmark, we establish that the SD-flat benchmark has a one-unit asymptotic risk advantage near the origin, crosses over in the critical regime, and is second-order equivalent to the variance-flat benchmark for strong signals. Proper single global-scale hyperpriors and bounded coordinate-multiplier mixtures inherit these limits through the near-zero exponent of their SD-scale density. For heavier-tailed or sparse priors, that exponent still classifies the common global-scale component, while local-scale tails, model-size priors, or allocation priors can also affect risk.