New AI Chip Beats Nvidia, AMD and Intel by a Mile with 20x Faster Speeds and Over 4 Trillion Transistors

A seismic shift is occurring in the artificial intelligence hardware market driven by a new contender: Cerebras Systems. Recently, the California-based startup announced the launch of Cerebras Inference, a groundbreaking solution claimed to be 20 times faster than Nvidia (NVDA)'s GPUs.

Cerebras has developed what it calls the Wafer Scale Engine, the third generation of which powers the new Cerebras Inference. This massive chip integrates 44GB of SRAM and eliminates the need for external memory, which has been a significant bottleneck in traditional GPU setups. By resolving the memory bandwidth issue, Cerebras Inference can deliver a whopping 1,800 tokens per second for Llama3.1 8B and 450 tokens for Llama3.1 70B, setting new industry standards for speed.