Ethical Issues in Advanced Artificial Intelligence

  • Bostrom N
  • 113


    Mendeley users who have this article in their library.
  • N/A


    Citations of this article.


The ethical issues related to the possible future creation of machines with general intellectual capabilities far outstripping those of humans are quite distinct from any ethical problems arising in current automation and information systems. Such superintelligence would not be just another technological development; it would be the most important invention ever made, and would lead to explosive progress in all scientific and technological fields, as the superintelligence would conduct research with superhuman efficiency. To the extent that ethics is a cognitive pursuit, a superintelligence could also easily surpass humans in the quality of its moral thinking. However, it would be up to the designers of the superintelligence to specify its original motivations. Since the superintelligence may become unstoppably powerful because of its intellectual superiority and the technologies it could develop, it is crucial that it be provided with human-friendly motivations. This paper surveys some of the unique ethical issues in creating superintelligence, and discusses what motivations we ought to give a superintelligence, and introduces some cost-benefit considerations relating to whether the development of superintelligent machines ought to be accelerated or retarded.

Author-supplied keywords

  • artificial intelligence
  • cost-benefit analysis
  • ethics
  • global security
  • superintelligence
  • uploading

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in

Find this document


  • Nick Bostrom

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free