Hugo Mercier on why gullibility and misinformation are overrated
80,000 Hours, February 21, 2024
Abstract
Humans are not inherently gullible. Reasoning evolved to facilitate beneficial communication, not indiscriminate belief. Skepticism is crucial for communication to be advantageous, as evidenced by the limited communication systems of other great apes who exhibit high levels of distrust. The concept of “open vigilance” suggests that humans are open to new information when presented with sound arguments or trustworthy sources, but also vigilant in assessing the plausibility of claims and the credibility of communicators. While humans readily update beliefs on trivial matters, deeply held beliefs are more resistant to change. Seemingly irrational beliefs, like those underpinning financial scams or alternative medicine, often stem from intuitive desires (e.g., to belong, to take action) rather than epistemic errors. Similarly, political misperceptions can be driven by limited personal stakes in policy outcomes. While AI-generated misinformation poses a theoretical threat, the real bottleneck remains human attention, which is primarily directed by established media sources. Ultimately, the demand for truth, coupled with institutional accountability, ensures a continuous supply of reliable information, regardless of technological advancements. – AI-generated abstract.