Geoffrey Hinton
Professor Emeritus · Nobel Laureate (Physics 2024)
University of Toronto · ex-Google
Often called the "Godfather of Deep Learning". Co-invented backpropagation and deep neural networks. Left Google in 2023 to speak freely about AI existential risks. One of the most cited researchers in history.
Core Positions & Ideas
Deep Learning Works — Finally
2006Co-published the landmark paper on training deep belief networks using contrastive divergence, breaking a decade-long stagnation in neural network research. This directly triggered the deep learning revolution and validated decades of neural net research.
GPUs + Deep Nets Will Win Everything
2012Led AlexNet at ImageNet 2012, reducing the top-5 error rate from ~26% to ~15% — a shock to the computer vision field. Famously auctioned his lab to Google, convinced that deep learning would dominate AI. That bet proved correct within five years.
Backpropagation May Need to Be Replaced
2022Briefly argued (2022) that backprop is biologically implausible and we may need fundamentally different learning algorithms. Proposed "forward-forward" as an alternative. The academic community was skeptical, and Hinton himself acknowledged this was speculative.
I Regret My Life's Work — AI Risk Is Existential
2023Left Google in May 2023 to speak freely about AI dangers. Stated publicly there is a 10–50% chance that AI systems will eventually kill humanity. A dramatic reversal: for decades he dismissed AI safety concerns as premature. Now calls himself 'a pessimist.' His defection from the optimist camp sent shockwaves through the industry.
LLMs May Actually Understand — Against the 'Stochastic Parrot' View
2023Argued that large language models likely have a form of understanding and representation, not just statistical pattern-matching. This put him at odds with critics like Gary Marcus and the 'Stochastic Parrots' paper. His view: if something behaves intelligently in diverse contexts, dismissing it as 'mere statistics' may be intellectually dishonest.
Essential Reading & Watching
Learning Representations by Back-propagating Errors
The foundational backpropagation paper (with Rumelhart & Williams). Remains one of the most cited papers in all of computer science and the basis of essentially all modern deep learning.
Read / Watch →
ImageNet Classification with Deep Convolutional Neural Networks (AlexNet)
The AlexNet paper that triggered the deep learning revolution. Won ImageNet 2012 by a massive margin, convincing the entire field that deep neural networks were the path forward.
Read / Watch →
The Forward-Forward Algorithm: Some Preliminary Investigations
Hinton's exploration of a backprop-free learning algorithm. Speculative but intellectually serious — demonstrates his continued willingness to challenge his own foundational work.
Read / Watch →
"Will Digital Intelligence Replace Biological Intelligence?" (MIT talk)
Hinton's most comprehensive public statement on AI risk after leaving Google. Covers his changed views on existential risk, digital vs. biological intelligence, and why he now thinks we may be building something more dangerous than we realize.
Read / Watch →