We consider the location-scale family of all multivariate continuous sampling distributions. Any model from the subclass induced by fixing a particular distribution on the unit sphere, combined with a standard improper prior on the scale parameter, will lead to the same inference on location and observables. This finding sheds light on many robustness results in less general models and its implications are illustrated in a number of examples.