works
Jacob Steinhardt What will GPT-2030 look like? online GPT-4 surprised many people with its abilities at coding, creative brainstorming, letter-writing, and other skills. How can we be less surprised by developments in machine learning? In this post, I’ll forecast the properties of large pretrained ML systems in 2030.

What will GPT-2030 look like?

Jacob Steinhardt

Bounded Regret, June 7, 2023

Abstract

GPT-4 surprised many people with its abilities at coding, creative brainstorming, letter-writing, and other skills. How can we be less surprised by developments in machine learning? In this post, I’ll forecast the properties of large pretrained ML systems in 2030.

PDF

First page of PDF