Uncommon priors require origin disputes
Theory and Decision, vol. 61, no. 4, 2006, pp. 319–328
Abstract
In standard belief models, priors are always common knowledge. This prevents such models from representing agents’ probabilistic beliefs about the origins of their priors. By embedding standard models in a larger standard model, however, pre-priors can describe such beliefs. When an agent’s prior and pre-prior are mutually consistent, he must believe that his prior would only have been different in situations where relevant event chances were different, but that variations in other agents’ priors are otherwise completely unrelated to which events are how likely. Due to this, Bayesians who agree enough about the origins of their priors must have the same priors.
Quotes from this work
Without some basis for believing that the process that produced your prior was substantially better at tracking truth than the process that produced other peoples’ priors, you appear to have no basis for believing that beliefs based on your prior are more accurate than beliefs based on other peoples’ priors.