Gary Marcus? Sam Altman? Apocryphal?

Question for Quote Investigator: The progress achieved in artificial intelligence (AI) during the 21st century has been remarkable. Billions of dollars have been spent to build supercomputers and to train AI systems. Yet, the rate of future progress is uncertain. A skeptic stated:
Deep learning is hitting a wall.
An enthusiast replied:
There is no wall.
Would you please help me to identify the people in this exchange and find precise citations?
Reply from Quote Investigator: In 2022 cognitive scientist and AI researcher Gary Marcus published an article in the popular science magazine “Nautilus” with the following provocative title:1
Deep Learning Is Hitting a Wall
The piece argued that the field of artificial intelligence was filled with hype and bravado. Also, current AI systems did not “genuinely understand human language” and displayed “nowhere near the ordinary day-to-day intelligence of Rosey the Robot” (from “The Jetsons” animated TV series of the 1960s).
The article said that the strategy of building larger systems with more chips and more data was “perhaps already approaching a point of diminishing returns”, and the AI field should pursue a neurosymbolic approach.
In November 2024 Sam Altman, the CEO of the leading AI company OpenAI tweeted the following riposte:2
there is no wall
Later, Gary Marcus tweeted the following reply:3
1. Multiple media reports from multiple companies are reporting diminishing returns, exactly as I warned in 2022 in “deep learning is hitting a wall”.
2. If I am wrong, where is GPT-5?
From 2018 to 2024 OpenAI announced a series of models called GPT-1, GPT-2, GPT-3, GPT-3.5, GPT-4 and GPT-4o. But a model named GPT-5 was not released in 2024.
Beginning in September 2024 OpenAI announced a different series of models called o1 and o3. These models used more computation to ruminate about complex tasks. The o3 model achieved new high scores on difficult benchmark tests for mathematics, programming, and fluid intelligence.
Below are additional selected citations in chronological order.
Continue reading “Dialogue Origin: “Deep Learning Is Hitting a Wall” “There Is No Wall””