Examples of AI Improving AI

Abstract

As machine learning algorithms become more capable of outperforming humans on some narrow tasks, they are increasingly being used to make improvements to themselves or other machine learning systems, or inputs to those systems such as hardware. In some cases, human feedback used to improve models has been replaced with AI feedback; in other cases, GPU circuits that were once designed by humans are being designed by AI systems. Some have warned that this “recursive self-improvement,” if scaled up, could lead to AI spiraling beyond human control.