Scaling: the state of play in AI

Abstract

A survey of where AI capabilities stand and what might come next, focused on the large language models that power chatbots like ChatGPT and Gemini. The piece examines how larger AI models demonstrate improved performance across tasks, exploring training-based scaling laws alongside a newly identified “thinking” scaling mechanism that enables models to allocate additional computational resources to problem-solving after training completion.