Carl Shulman on government and society after AGI (Part 2)
80,000 Hours, July 5, 2024
Abstract
The advent of artificial general intelligence (AGI) capable of providing trustworthy advice has the potential to revolutionize governance and society. AGI advisors could provide insights into complex issues, such as pandemics and national security, leading to better policy decisions and a more informed public discourse. The paper outlines how AGI could have dramatically improved the response to the COVID-19 pandemic, arguing that its use would have led to earlier investments in pandemic preparedness, more timely information sharing, and faster vaccine development and deployment. However, the paper also highlights potential downsides, such as the risk of AI being used to entrench existing values and ideologies, or even facilitating coups by providing power to those in control of the AI-driven military and police forces. The paper concludes by discussing the importance of international cooperation in regulating the development of AI and ensuring that all parties can trust the output of AGI advisors. – AI-generated abstract