Intel showcased its Gaudi3 Processor for artificial intelligence (AI) workloads alongside the formal introduction of its 14th-Gen Core Ultra "Meteor Lake" processors and 5th-Gen Xeon Scalable CPUs for datacenters. The accelerator is set to arrive in 2024 and will offer a significant performance bump compared to its predecessor, the Gaudi2.
Intel CEO Gelsinger discussed the upcoming release of Intel's Gaudi3, which is scheduled for next year, and showed off the new AI accelerator aimed at deep learning and large-scale generative AI models for the first time. The new unit looks like a huge module (OAM, we presume) with a massive ASIC and multiple HBM3 (or HBM3E) memory stacks on it. The ASIC package looks significantly larger than the Gaudi2, so we presume that it is equipped with eight HBM3E stacks on it (rather then with six in case of Gaudi2). Based on a slide Intel presented at SC23, Gaudi3 is not a monolithic processor, but rather a dual-chiplet design that fuses together two processors.
In addition, Intel announced that the Gaudi3 will offer four times higher BF16 performance, two times faster networking performance, and 1.5X higher bandwidth compared to Gaudi2.
"Our Gaudi roadmap remains on track with Gaudi3 out of the fab, now in packaging and expected to launch next year," said Pat Gelsinger, CEO of Intel, at the company's latest conference call (via SeekingAlpha). In 2025, Falcon Shores brings our GPU and Gaudi capabilities into a single product."
