xAI Opts for Ethernet in Massive Training Cluster
In a departure from the norm, xAI’s groundbreaking Colossus training cluster is sidestepping InfiniBand in favor of Ethernet connectivity. This decision marks the system as distinct within the realm of AI training infrastructures. The hardware includes an impressive 100,000 Nvidia…