English 箭头
Podcast Cover

[The AI Bubble: Why the Scaling Law Failed and What’s Next]-[Ep. 367: What if AI Doesn’t Get Much Better Than This?]

Deep Questions with Cal Newport · B2 · 2025-08-25

Careers
Or study on the web version

📋 Summary

The Shift in AI Euphoria

For years following the launch of ChatGPT, the tech industry and media were gripped by a mixture of euphoria and dread, fueled by claims that AI was on the verge of replacing human labor on a massive scale. Tech CEOs like Anthropic’s Dario Amadei and OpenAI’s Sam Altman fostered a narrative that we were rapidly approaching "superintelligence," often comparing their work to the Manhattan Project. However, in recent months, this narrative has shifted dramatically. The release of GPT-5 served as a pivotal "needle scratch" on the industry's hype-filled record, revealing that the anticipated exponential leap in capability simply did not arrive.

The Death of the Scaling Law

The foundation of the AI boom was the "scaling law," an empirical observation suggesting that simply increasing compute power, data, and model size would lead to increasingly capable AI. As Jensen Wong of NVIDIA noted, this strategy worked for GPT-3 and GPT-4, leading many to believe that scaling alone would eventually reach Artificial General Intelligence (AGI). However, the industry hit a wall. As reported by The Information, the leap from GPT-4 to GPT-5 was "far smaller" than previous iterations. Similar struggles were faced by Meta and XAI, despite throwing massive computing resources—such as Elon Musk’s 200,000-GPU "Colossus" cluster—at the problem. The era of "pre-training" scaling, which promised a direct path to AGI, has effectively stalled.

From Innovation to Incrementalism: The Era of Post-Training

With the scaling strategy failing, the industry pivoted to "post-training" techniques—what Cal Newport describes as "souped-up" versions of existing models. Rather than creating a Ferrari from scratch, engineers are now acting as mechanics, fine-tuning existing models through reinforcement learning, synthetic data, and "test-time compute" (having the AI spend more time "thinking"). While these methods yield improvements on narrow, specific benchmarks, they do not represent the revolutionary leap promised by the original scaling laws. This explains the recent influx of confusingly named models and the industry’s shift toward bragging about minor percentage gains on obscure metrics.

The Economic Reality Check

The disconnect between AI hype and economic reality is becoming increasingly apparent. Technology analyst Ed Zitron points out that despite massive capital expenditures—estimated at $560 billion by the "Magnificent Seven" tech companies over 18 months—actual AI revenue remains minuscule (roughly $35–40 billion). Headlines linking tech layoffs to AI displacement are often misinformed; as Newport observes, these layoffs are largely due to post-pandemic tech contractions and over-hiring, not AI replacement. The "vibe" of AI-driven disruption is currently disconnected from data.

A More Gradual Future

While the dream of an imminent AI-driven economic apocalypse is likely hyperbole, the technology remains powerful. We are entering a period where AI will be more fragmented and gradual in its impact. Rather than one singular "digital god" replacing all jobs, we are likely to see bespoke, narrow applications that solve specific problems. As Gary Marcus suggests, achieving true AGI may require entirely new theoretical breakthroughs—such as neuro-symbolic AI—rather than just bigger language models.

In conclusion, the industry’s attempt to keep the hype alive after the scaling laws stopped working has been disingenuous, but it does not mean the technology is a bust. We have been granted a "reprieve" from the existential fear of the robot apocalypse, providing society, regulators, and ethicists a crucial window to develop a more grounded, ethical framework for the technology’s actual, more measured, and ultimately more useful future.

🎯Key Sentences

1
I've been building AI for over a decade.
2
And I'm not making this up, Jesse.
3
The bill is due.
4
I'm mixing metaphors here, Jesse.
Expand All

📝Key Phrases

1
swept up in
2
looming impacts
3
back up a little bit
4
salient feature
5
over the top
Expand All

📖 Transcript

In the years since ChatGPT's astonishing launch, it's been hard not to get swept up in feelings of euphoria or dread about the looming impacts of this new type of artificial intelligence.
But in recent weeks, this vibe seems to be shifting.
Both the media and technologists no longer seem so certain that everything is about to change.
Now, how is this possible?
What went wrong?
What should we really expect from this tech in the next few years?

ListenLeap Brings You Into Real Context Learning

🎨 Interesting Content
🌍 Real Materials
📱 Listen Anytime
Or study on the web version