2 ms·
> With the above prior and likelihood, the posterior for β is a product of independent Gaussians with unit variance and mean given by the least squares estimato
by kgwgk 9y ago
> With the above prior and likelihood, the posterior for β is a product of independent Gaussians with unit variance and mean given by the least squares estimator of β. The problem is that standard concentration of measure inequalities show that this posterior is not uniformly distributed in a unit ball around the ordinary least squares estimator but rather is exponentially close in the number of coefficients to a sphere of radius 1 centered at the estimate.
Of course the posterior is not uniformly distributed in a unit ball (the density is higher at the center of the ball, and extends beyond the limits of the ball). But the fact that it is exponentially close to a sphere doesn’t have anything to do with that! If the posterior was uniformly distributed in a unit ball it would also be exponentially close to a sphere.