When Intel announced its Gaudi 2 and Gaudi 3 accelerators for AI, it said that the total cost of ownership would be a fraction of that of Nvidia's H100, but never revealed any actual numbers. At the Intel's keynote at Computex 2024 the company finally revealed pricing of its latest AI processors and it appears that eight Gaudi 2 processors on a baseboard will cost less than one Nvidia B200 is rumored to cost.
Intel charges $65,000 per eight Gaudi 2 accelerators on a baseboard and $125,000 per eight Gaudi 3 processors on a baseboard, as shown by our colleague Jim McGregor from Tirias Research. This means that a single Gaudi 2 is priced at around $8,125, whereas a Gaudi 3 costs around $15,650 — of course, when purchased in bulk and with a baseboard. Yet, for large customers buying in huge quantities Intel can certainly make further per-unit discounts.
