On singularities and simulations

Abstract

This work explores consequences of a hypothesized computer simulation in which artificial intelligences (AIs) design AIs even more intelligent than themselves, and each new generation of AIs rapidly creates still more powerful AIs. The combination of superintelligence and massive power will make it possible for computers to create and sustain virtual environments of a size and complexity that is way beyond anything we are currently capable of devising. It is possible — or even probable — that we ourselves are among their (virtual) inhabitants. The prospect of all this would no doubt appeal to a great many, and there would inevitably be some people who would be more than happy to have themselves uploaded into these virtual worlds. However, while the prospect of vastly enhanced lives in virtual worlds may or may not prove enticing, the idea that one is leading a real physical life when one is in fact merely an avatar existing in a virtual world is disturbing enough. More importantly, it could have wide ethical implications, especially if ethical scruples do not prevent future AIs from creating virtual lives merely for their own entertainment, as a diversion, or for use in scientific experiments. – AI-generated abstract.