Nvidia-backed startup invents Ethernet memory pool to help power AI — claims it can add up to 18TB of DDR5 capacity for large-scale inference workloads and reduce per-token generation costs by up to 50%

Enfabrica.

RAM capacity tends to be a bottleneck for numerous AI applications, but adding memory to host systems is sometimes not possible or complicated, so Enfabrica, a startup supported by Nvidia, has invented its Emfasys system that can add terabytes of DDR5 memory to any server using an Ethernet connection. The memory pool over the Ethernet system is designed for large-scale inference workloads and is currently tested with select clients.

Enfabrica's Emfasys system is a rack-compatible system based on the company's ACF-S SuperNIC with a 3.2 Tb/s (400 GB/s) throughput. It connects up to 18 TB of DDR5 memory with CXL on top. The memory pool can be accessed by 4-way and 8-way GPU servers through standard 400G or 800G Ethernet ports using Remote Direct Memory Access (RDMA) over Ethernet, so adding an Emfasys system to almost any AI server is seamless.