New AI Chip Leaves Nvidia, AMD, and Intel in the Dust with 20x Faster Speeds and Over 4 Trillion Transistors

A game-changing shift is underway in the artificial intelligence hardware industry, driven by a surprising new player: Cerebras Systems. The California-based startup recently unveiled Cerebras Inference, a cutting-edge solution reportedly up to 20 times faster than Nvidia (NVDA) GPUs, sparking attention across the tech landscape.

Cerebras’ breakthrough innovation, the Wafer Scale Engine, now in its third generation, powers this new Cerebras Inference system. This enormous chip packs 44GB of SRAM and requires no external memory, eliminating a key bottleneck found in traditional GPU setups. By addressing memory bandwidth limitations, Cerebras Inference achieves impressive speeds—processing 1,800 tokens per second for Llama3.1 8B and 450 tokens for Llama3.1 70B—setting a new performance standard in the industry.