Urging an international AI treaty: an open letter

Abstract

An open letter signed by hundreds of AI experts, academics, and public figures — including Yoshua Bengio, Max Tegmark, Gary Marcus, and Victoria Krakovna — calling on world leaders to negotiate an international treaty on artificial intelligence to address its catastrophic risks. The letter proposes core provisions such as globally upheld thresholds on the compute used to train AI models (to be tightened over time as algorithms improve), a CERN-like collaborative laboratory for AI safety, and safe APIs that keep model capabilities within estimated safe limits. The initiative is led by superforecaster Tolga Bilge.