Preventing an AI-related catastrophe

Benjamin Todd

80,000 Hours, August 25, 2022

Abstract

Why do we think that reducing risks from AI is one of the most pressing issues of our time? There are technical safety issues that we believe could, in the worst case, lead to an existential threat to humanity.

PDF

First page of PDF

Quotes from this work

But also, as we’ve discussed, even if we successfully manage to make AI do what we want (i.e. we ‘align’ it), we might still end up choosing something bad for it to do! So we need to worry about the incentives not just of the AI systems, but of the human actors using them.