The hidden complexity of wishes

Abstract

An animated adaptation of Eliezer Yudkowsky’s essay “The Hidden Complexity of Wishes”. Through the thought experiment of an “Outcome Pump” that can alter probabilities to grant wishes, the video illustrates why specifying our values to a powerful optimizer is far harder than it seems, and why humanity currently has no idea how to make AIs follow complex goals that track human values.