RoCE v2: RDMA over Converged Ethernet for AI-Scale Networking

A GPU cluster with terabytes of pooled memory and blistering local bandwidth is only as good as the fabric that lets thousands of those GPUs exchange gradients, activations, and KV cache fragments with each other in microseconds. That fabric, for a large and growing share of AI training and inference clusters, runs on RDMA over Converged Ethernet version 2, or RoCE v2.