works
Paul Christiano Hedonic asymmetries online Evolution’s “tricks” have created difficulties in creating optimistic outcomes. The asymmetry between creating negative and positive outcomes is caused by the reward system in nature. Errors in reward evaluation are not equally costly; pessimistic errors are manageable, but optimistic errors are catastrophic because they lead to the pursuit of non-existent rewards and the avoidance of actual punishments. This is a result of evolution’s focus on preventing harm, which has led to mechanisms that make it harder to find loopholes for positive rewards. Therefore, creating highly positive outcomes is an adversarial game against evolution, and evolution’s strategies, such as boredom and aversion to meaningless pleasures, present challenges. However, these challenges do not make creating good worlds impossible but rather more difficult. – AI-generated abstract.

Hedonic asymmetries

Paul Christiano

The sideways view, January 26, 2020

Abstract

Evolution’s “tricks” have created difficulties in creating optimistic outcomes. The asymmetry between creating negative and positive outcomes is caused by the reward system in nature. Errors in reward evaluation are not equally costly; pessimistic errors are manageable, but optimistic errors are catastrophic because they lead to the pursuit of non-existent rewards and the avoidance of actual punishments. This is a result of evolution’s focus on preventing harm, which has led to mechanisms that make it harder to find loopholes for positive rewards. Therefore, creating highly positive outcomes is an adversarial game against evolution, and evolution’s strategies, such as boredom and aversion to meaningless pleasures, present challenges. However, these challenges do not make creating good worlds impossible but rather more difficult. – AI-generated abstract.

PDF

First page of PDF