'The CPU is the system’s executive layer': Intel joins SambaNova as both face existential threat from Nvidia’s Groq-powered inference

Intel graphics cards.

• GPUs handle prefill operations by converting prompts into key-value caches
• SambaNova RDUs generate tokens at high throughput and low latency
• Intel Xeon 6 processors manage workload distribution and execute compiled code

Intel and SambaNova Systems have introduced a joint hardware blueprint combining GPUs, SambaNova RDUs, and Intel Xeon 6 processors for large-scale inference workloads.