Other than the AI bubble bursting or hype dying down, the other thing that could allow the RAMpocalypse to ease off is a technological change that leads to a dramatic reduction in how much memory AI needs. To that end, Google has cooked up TurboQuant, a new compression algorithm that promises to reduce memory demand by about 6x. And memory maker stock prices have already dropped, likely as a result of this.
Although we should resist being reductive and assuming Google's new algorithm is responsible for these market changes—lest we forget the effects on crucial material availability thanks to the war in Iran—a 6x claimed reduction in memory demand must surely account for at least some of it.
