The war for artificial intelligence (AI) supremacy has a new central battleground, and it is inference. Apart from the established winners of the training era, such as Nvidia (NVDA) and AMD (AMD), hyperscalers are increasingly becoming important players here by making their own custom AI chips.
Alphabet's (GOOG) (GOOGL) Google, with its TPUs, got a head start; however, Microsoft (MSFT), with the launch of the Maia 300 AI chip in 2027, is not willing to cede ground. Promising 40% more token output per megawatt than the GPU systems dominated by Nvidia and AMD, the company has developed the chip with a focus on inference. To be manufactured through TSMC's (TSM) leading 2nm process, Microsoft said in a statement, “Maia 300 is designed with an inference-first architecture optimized for long-context, memory-intensive and decode-heavy AI workloads. This involves balancing compute, memory bandwidth, networking and power efficiency at cloud scale.”