In 1958, two of the most respected computer scientists alive predicted that a computer would be world chess champion within ten years. It took 29. In 1967, the co-founder of the MIT AI Lab said artificial intelligence would be "substantially solved" within a generation. It wasn't. In 1993, a mathematician predicted the Singularity by 2023. It didn't happen.

This pattern repeats with startling consistency. Brilliant people, looking at the state of AI, confidently predict when human-level machine intelligence will arrive. They are wrong every time. Not because they are foolish — many were Turing Award winners, Nobel laureates, pioneers of the field. But the problem they were predicting turned out to be harder than it looked from the inside.

This matters now because the same structural optimism that produced those failed forecasts is baked into contemporary P(doom) estimates. P(doom) — the probability of catastrophic AI outcomes — depends heavily on P(AGI), the probability that artificial general intelligence gets built. If your timeline for AGI is too short, your P(doom) is probably too high.

P(doom) Calculator

Estimate your own P(doom) by adjusting probability inputs for key risk factors — including P(AGI). See how your assumptions combine.

P(doom) Calculator →

Note on sources: The systematic tracking of failed AI predictions is the project of the Boys Who Cried AI archive, which maintains a growing, filterable database of 50+ falsified forecasts. Our focus here is different: not cataloguing predictions, but analysing why they fail — and what that means for how you set your P(doom).

Three Eras of Failed Forecasts

Instead of listing every prediction chronologically (the archive does that better than we could), we'll group them by era and extract the pattern each era reveals.

The Symbolic AI Era (1958–1970)

Herbert Simon (Turing Award, Nobel Prize) and Marvin Minsky (Turing Award, MIT AI Lab co-founder) were not outsiders. They were the field's founding figures. And yet:

  • Simon & Newell, 1958: world chess champion computer within 10 years. Reality: 1997, 29 years late.
  • Simon, 1965: machines doing any human work within 20 years. Reality: by 1985, symbolic AI had stalled entirely.
  • Minsky, 1967: AI "substantially solved" within a generation. Reality: not solved 60 years later.
  • Minsky, 1970: general intelligence of an average human in 3–8 years. Reality: by 1978, the field was in its first winter.

The pattern of this era: the easy parts looked like the whole problem. Early programs could prove theorems and play chess at a basic level. It seemed like general intelligence was just a matter of scaling up. It wasn't. The remaining problems — common sense reasoning, language understanding, sensorimotor integration — were qualitatively different and far harder.

The Hardware Extrapolation Era (1985–1995)

Hans Moravec (robotics pioneer) and Vernor Vinge (mathematician, SF author) shifted the argument. Instead of reasoning about algorithms, they reasoned about hardware:

  • Moravec, 1988: computers with humanlike abilities by 2010, based on exponential hardware growth. Reality: the hardware extrapolation was roughly correct. The capability was not. Hardware was not the bottleneck.
  • Vinge, 1993: Singularity within 30 years. Reality: 2023 passed. GPT-4 launched that year — impressive, but not superhuman intelligence.
  • I. J. Good, 1965 (ahead of his era but conceptually similar): ultraintelligent machine within the 20th century, via recursive self-improvement. Reality: the century closed with no such machine.

The pattern of this era: hardware ≠ capability. Moravec's compute extrapolation was numerically sound — computers did get exponentially faster. But the assumption that general intelligence would emerge from sufficient compute turned out to be a category error. Chess, Jeopardy, Go — each was solved by a combination of compute and narrow technique. None generalised.

The Recursive Improvement Era (1996–present)

Eliezer Yudkowsky (MIRI co-founder) predicted in 1996 that once AI reaches human equivalence, a recursive self-improvement loop would trigger a Singularity within years. The deadline passed in 2021 with no Singularity.

What's notable here is not just the failed timeline — it's the response. Yudkowsky acknowledged the failure and revised his framework. But his P(doom) estimate remained above 95%. This raises a question we'll return to: if your timeline prediction was wrong, should your doom probability also be adjusted?

Four Structural Reasons Forecasts Fail

Across six decades and three eras, the same four failure modes repeat. Understanding them is more useful than memorising any individual prediction.

1. Extrapolating from current progress

Every forecaster looked at the rate of progress in their era and assumed it would continue. Simon saw rapid advances in symbolic reasoning and assumed the trajectory would hold. Moravec saw exponential hardware growth and assumed capability would follow. Both were wrong because progress is not smooth — it hits walls, changes paradigms, and stalls in ways that are invisible from the inside.

2. Underestimating the problem

Minsky believed AI would be "substantially solved" in a generation because the problems that remained seemed tractable. They weren't — they were the hard parts. The easy parts had been solved first, creating an illusion that the rest would follow. This is the classic "last 10% takes 90% of the time" problem, applied to an entire research field.

3. Confusing narrow capability with general intelligence

Simon's chess prediction is the clearest example. A computer did become chess champion — eventually. But chess turned out to be a narrow problem solvable by brute-force search, not a stepping stone to general intelligence. The same pattern repeated with Jeopardy (Watson), Go (AlphaGo), and language generation (GPT). Each milestone was real, none led to AGI.

4. Institutional and financial incentives

Some predictions were made by people whose careers or funding depended on AI appearing imminent. Not all — Simon and Minsky had tenure and reputation to burn — but the broader pattern of over-optimistic AI forecasting is reinforced by a funding environment that rewards urgency. "AGI in 5 years" attracts more investment than "AGI in 50 years, maybe never."

What This Means for P(doom)

P(doom) is decomposed in our calculator as roughly:

P(doom) = P(AGI) × P(misalign|AGI) × P(catastrophe|misalign) + P(misuse) − overlap

The first term — P(AGI), the probability of developing artificial general intelligence — is where 60 years of failed predictions should give you pause. If nobody has successfully predicted AGI timelines in six decades of trying, the rational response is not to pick a new timeline and be confident about it. The rational response is to widen your uncertainty.

This doesn't mean AGI is impossible. It means that if you're setting P(AGI by 2100) at 90% because GPT-4 seems impressive, you're making the same mistake Simon made in 1958 when he looked at early chess programs and saw world-champion-level play within a decade. The view from inside a capability wave always looks like the wave will continue. It usually doesn't.

Conversely, if you're setting P(AGI) at 5% because every past prediction failed, you might be making the opposite error — assuming that because it hasn't happened yet, it never will. The correct response to 60 years of failed predictions is not pessimism or optimism. It's calibrated humility.

Calibrate Your Own Estimate

Use our P(doom) Calculator to break down your estimate into its components. Adjust P(AGI) based on what 60 years of failed predictions teaches us about timeline uncertainty.

Open Calculator →

The Archive: A Growing Record

The predictions above are a sample. The Archive of Incorrect AI Predictions at Boys Who Cried AI maintains a continuously updated, filterable database of 50+ dated and falsified AI forecasts. Each entry includes the predictor, their credentials, the specific claim, the deadline, and a clear explanation of why it was wrong.

What makes the archive valuable is its rigour. It doesn't collect vague hand-waving — it collects specific, dated predictions from named individuals with verifiable credentials. This is the kind of accountability record that the AI forecasting field has needed for a long time.

FAQ

AI predictions fail because they extrapolate from current progress rates without accounting for unexpected bottlenecks, paradigm shifts, and the difference between narrow capability demonstrations and general intelligence. Researchers also tend to be over-optimistic about timelines, especially when affiliated with organisations that benefit from urgency narratives.
Herbert Simon and Allen Newell's 1958 prediction that a computer would be world chess champion within ten years is among the most famous. It took until 1997 — 29 years late. Marvin Minsky's 1967 claim that AI would be "substantially solved" within a generation is another well-known miss.
P(doom) depends partly on P(AGI) — the probability that artificial general intelligence is developed. If expert timeline predictions have been systematically too optimistic for 60 years, current AGI timeline estimates may also be too aggressive, which would lower P(doom) all else being equal.
The Archive of Incorrect AI Predictions at boyswhocriedai.lovable.app/archive tracks 50+ dated and falsified AI forecasts from 1958 to the present, each with the predictor, the claim, the deadline, and why it was wrong.
Ray Kurzweil's 1990 prediction that a computer would defeat the world chess champion by 1998 was close — Deep Blue won in 1997. But Kurzweil bundled this with other claims (speech-to-text replacing keyboards, real-time phone translation) that did not arrive on schedule. No forecaster has correctly predicted AGI arrival.
No. Failed predictions don't prove AGI is impossible — they prove that forecasting it is hard. The rational response is not "never" but "with high timeline uncertainty." Set your P(AGI) with the awareness that every previous confident timeline was wrong.

Sources & References

  • Simon, H. A. & Newell, A. (1958): "Heuristic Problem Solving: The Next Advance in Operations Research." Operations Research, 6(1). Chess prediction quote.
  • Simon, H. A. (1965): "The Shape of Automation for Men and Management." Harper & Row. "Machines will be capable, within twenty years" quote.
  • Good, I. J. (1965): "Speculations Concerning the First Ultraintelligent Machine." Advances in Computers, 6. Intelligence explosion argument.
  • Minsky, M. (1967): Computation: Finite and Infinite Machines. Prentice-Hall. "Substantially solved" quote.
  • Minsky, M. (1970): Interview in Life Magazine, November 1970. "Three to eight years" quote.
  • Moravec, H. (1988): Mind Children: The Future of Robot and Human Intelligence. Harvard University Press. "Humanlike abilities by 2010" prediction.
  • Vinge, V. (1993): "The Coming Technological Singularity." VISION-21 Symposium, NASA Lewis Research Center. "Within thirty years" prediction.
  • Yudkowsky, E. (1996): "Staring into the Singularity." Self-published essay. Recursive self-improvement timeline.
  • Boys Who Cried AI (2026): Archive of Incorrect AI Predictions. 50+ dated and falsified AI forecasts. → boyswhocriedai.lovable.app/archive
  • Grace, K. et al. (2024): "Thousands of AI authors on the future of AI." arXiv:2401.02843. Survey of 2,778 AI researchers on AGI timelines. → arXiv

Related Tools

Explore AI risk quantification further with our calculator suite.

P(doom) Calculator → What is P(doom)? → Expert Estimates →