AI workloads require new network build-outs

According to the new AI Networks for AI Workloads report by Dell’Oro Group, spending on switches deployed in AI back-end networks is forecast to expand the Data Center Switch Market by 50 percent.

  • Tuesday, 16th January 2024 Posted 1 year ago in by Phil Alsop

Current data center switch market spending is on front-end networks used primarily to connect general-purpose servers. AI workloads will require a new back-end infrastructure buildout. The competition intensifies between InfiniBand and Ethernet as manufacturers vie for market dominance in AI back-end networks. While InfiniBand is expected to maintain its lead, Ethernet is forecast to make substantial gains, such as 20 revenue-share points by 2027.

“Generative AI applications usher in a new era in the age of AI, standing out for the sheer number of parameters that they have to deal with,” said Sameh Boujelbene, Vice President at Dell’Oro Group. “Several large AI applications currently handle trillions of parameters, with this count increasing tenfold annually. This rapid growth necessitates the deployment of thousands or even hundreds of thousands of accelerated nodes. Connecting these accelerated nodes in large clusters requires a data center-scale fabric, known as the AI back-end network, which differs from the traditional front-end network used mostly to connect general-purpose servers.

“This predicament poses the pivotal question: what is the most suitable fabric that can scale to hundreds of thousands and potentially millions of accelerated nodes while ensuring the lowest Job Completion Time (JCT)? One could argue that Ethernet is one speed generation ahead of InfiniBand. Network speed, however, is not the only factor. Congestion control and adaptive routing mechanisms are also important. We analyzed AI back-end network build-outs by the major Cloud Service Providers (such as Google, Amazon, Microsoft, Meta, Alibaba, Tencent, ByteDance, Baidu, and others) as well as various considerations driving their choices of the back-end fabric to develop our forecast,” continued Boujelbene.

Additional highlights from the AI Networks for AI Workloads Report:

AI networks will accelerate the transition to higher speeds. For example, 800 Gbps is expected to comprise the majority of the ports in AI back-end networks by 2025, within just two years of the latest 800 Gbps product introduction.

While most of the market demand will come from Tier 1 Cloud Service Providers, Tier 2/3 and large enterprises are forecast to be significant, approaching $10 B over the next five years. The latter group will favor Ethernet.

AI agents break cover

Posted 3 days ago by Phil Alsop
In a global survey of IT leaders, Cloudera found that enterprises are keen on AI agents, but fears around data privacy, integration, and data quality...
Economist Impact is pleased to announce the inaugural AI Compute summit, scheduled for May 22nd 2025, at the Scandic Copenhagen in Copenhagen. This...

Majority of AI projects don't make it to market

Posted 4 days ago by Phil Alsop
SS&C Technologies Holdings has published findings from a new survey: governance, process orchestration and strategic planning are critical to...

Security and compliance risks make VPNs obsolete

Posted 4 days ago by Phil Alsop
Zscaler has published the Zscaler ThreatLabz 2025 VPN Risk Report, commissioned by Cybersecurity Insiders, which highlights the widespread security,...

AI tops tech growth charts

Posted 1 week ago by Phil Alsop
Despite high interest rates, economic slowdown, stricter regulations on big tech and AI, Trump's tariff policies, and global trade wars, which hit...

94% increase in network malware

Posted 1 week ago by Phil Alsop
Other key findings show an increase in crypto miner detections, a spike in zero-day malware, a drop in endpoint malware, a rise in Linux-based...

Data is not AI-ready

Posted 1 week ago by Phil Alsop
Despite rapid hybrid cloud adoption, enterprises struggle with file data migration, falling behind in AI-driven efficiencies and effective security.
96% of organizations attacked by ransomware said backups were targeted.