“And, to be abundantly clear, I am not sure there is enough training data in existence to get these models past the next generation. Even if generative AI companies were able to legally and freely download every single piece of text and visual media from the internet, it doesn’t appear to be enough to train these models, with some model developers potentially turning to model-generated "synthetic” data — a process that could introduce “model collapse,” a form of inbreeding that Jathan Sadowski called “Habsburg AI” that destroys the models over time.“
How Does OpenAI Survive?
Personally I think that the AI bubble is going to be the largest tech collapse since the dot com crash.
AI is dying
From “Where’s your Ed at?” by Edward Zitron:
A week and a half ago, Goldman Sachs put out a 31-page-report (titled “Gen AI: Too Much Spend, Too Little Benefit?”) that includes some of the most damning literature on generative AI I’ve ever seen. And yes, that sound you hear is the slow deflation of the bubble I’ve been warning you about since March.
The report covers AI’s productivity benefits (which Goldman remarks are likely limited), AI’s returns (which are likely to be significantly more limited than anticipated), and AI’s power demands (which are likely so significant that utility companies will have to spend nearly 40% more in the next three years to keep up with the demand from hyperscalers like Google and Microsoft).
This report is so significant because Goldman Sachs, like any investment bank, does not care about anyone’s feelings unless doing so is profitable. It will gladly hype anything if it thinks it’ll make a buck. Back in May, it was claimed that AI (not just generative AI) was ”showing very positive signs of eventually boosting GDP and productivity,“ even though said report buried within it constant reminders that AI had yet to impact productivity growth, and states that only about 5% of companies report using generative AI in regular production.
For Goldman to suddenly turn on the AI movement suggests that it’s extremely anxious about the future of generative AI, with almost everybody agreeing on one core point: that the longer this tech takes to make people money, the more money it’s going to need to make.
Full article:
Pop Culture