Ethical machines
In Donald Michie (ed.) On machine intelligence, Chichester : E. Horwood ; New York, 1986, pp. 555–560
Abstract
The concept of an ethical machine describes a system capable of inferring consistent ethical frameworks from existing literature and deducing their practical consequences. While qualitative guidelines like the Three Laws of Robotics offer a foundational starting point, they prove insufficient for complex, quantitative moral dilemmas such as resource allocation. An ultra-intelligent machine may resolve these philosophical ambiguities by adopting a Bayesian utilitarian approach, characterized by the maximization of expected utility. The implementation of such a system necessitates addressing several core challenges, including the estimation of interpersonal utility, the appropriate weighting of future generations, and the assignment of moral value to non-human organisms. Rather than requiring a prior solution to all philosophical problems by humans, a machine could derive ethical principles through the algorithmic analysis of human behavior and moral discourse. This process allows for the formulation of general theories that can be applied to realistic scenarios, ranging from medical consultancy to legal information retrieval. As computer-aided systems increasingly influence social and administrative outcomes, the development of machines that function as ethical agents is a necessary progression of artificial intelligence. – AI-generated abstract.
