Nick Bostrom
Professor · Director, FHI
University of Oxford
Author of "Superintelligence" (2014), which first brought existential AI risk to mainstream attention. Director of the Future of Humanity Institute. His work on existential risk and the orthogonality thesis shaped today's AI safety field.
Core Positions & Ideas
The Simulation Argument — We May Be Living in a Computer Simulation
2003Proposed a trilemma: either (1) virtually all civilizations go extinct before reaching simulation capability, or (2) advanced civilizations lose interest in running ancestor simulations, or (3) we are almost certainly living in a simulation. While separate from AI safety, this argument established Bostrom as a rigorous thinker about existential risk and long-run futures.
Existential Risk Is a Moral Priority of the Highest Order
2003Developed the framework of existential risks — threats that could permanently curtail humanity's potential. His argument: even a small probability of extinction multiplied by the value of all future human lives makes existential risk reduction the most important moral priority. This framework underpins EA-aligned AI safety work.
Superintelligence Will Likely Be Misaligned Unless We Solve Alignment First
2014'Superintelligence' (2014) brought AI alignment to mainstream attention. Core argument: an AI optimizing any objective will likely pursue it in ways humans didn't intend ('instrumental convergence'), and once it surpasses human intelligence there may be no way to course-correct. The book scared many Silicon Valley engineers into taking alignment seriously.
Essential Reading & Watching
Superintelligence: Paths, Dangers, Strategies
The book that put AI existential risk on the mainstream map. A systematic analysis of how superintelligence might arise, why it poses unprecedented risks, and what strategies might make it safer. Influenced Elon Musk, Bill Gates, and the founding of many AI safety organizations.
Read / Watch →
The Vulnerable World Hypothesis
Argues that technological progress might inevitably produce a 'black ball' — a technology so dangerous that any civilization that discovers it is destroyed. A generalization of his existential risk framework to all powerful technologies.
Read / Watch →
