AI's hunger for both power and memory, plus the resulting supply crisis of the latter, has led to many industry players engaging in a spot of creative problem solving. Case in point, Micron and Meta have collaborated on an experimental data centre roll out of low power DRAM.
Micron has developed SOCAMM2, a fresh form factor for LPDDR5X that is a "modular, serviceable module designed for servers." Testing used "Meta’s open-source DCPerf benchmark suite, which reflects production environments across a hyperscale fleet," and found that this low-power DRAM module "consumes approximately one-third the power of DDR5." According to Micron's white paper report, that accounts for under 7% of total system power.
