AI back-end networks to drive data centre switch spending

According to the new AI Networks for AI Workloads report by Dell’Oro Group, spending on switches deployed in AI back-end networks used to connect accelerated servers is forecast to approach $80 B over the next five years, nearly doubling the total data center switch market opportunity.

  • Wednesday, 17th July 2024 Posted 4 months ago in by Phil Alsop

Current data center switch market spending is on front-end networks used primarily to connect general-purpose servers but AI workloads will require a new back-end infrastructure buildout. While InfiniBand is currently dominating the AI back-end network market, Ethernet is poised to take over soon.

“As predicted, growth in AI workloads and the associated data center infrastructure continues to track well ahead of market expectations. We therefore raised our forecast for the AI back-end networks compared to our prior December 2023 forecast, though the latter was initially considered very aggressive by a number of industry players,” said Sameh Boujelbene, Vice President at Dell’Oro Group. “The upward adjustment was broad-based across Ethernet and InfiniBand. We are now, however, much more optimistic about the ability of Ethernet to eclipse InfiniBand within the next few years. This optimism stems from significant improvements on the technology side as well as market demand.

“On the technology side, we are observing significant enhancements on Ethernet at multiple layers of the stack: network chips, network operating systems, network interface cards and optics. In terms of demand, we are tracking significant new Ethernet wins, such as the latest 100K GPU cluster win announced by NVIDIA, among many other potential wins by other switch vendors including Celestica, Cisco, Arista, Juniper, and Nokia,” continued Boujelbene.

Additional highlights from the AI Networks for AI Workloads Report:

AI networks will accelerate the transition to higher speeds. The majority of the switch ports deployed in AI back-end networks are expected to be 800 Gbps by 2025 and 1600 Gbps by 2027.

While most of the market demand will come from Tier 1 Cloud Service Providers, we have significantly raised our forecast for Tier 2/3 and large enterprises in light of their accelerated pace of AI workload adoption and infrastructure deployment.

The promise of AI is on every biopharma’s radar, but the reality today is that much of the industry is grappling with how to convert the hype into...
IT teams urged to resolve ‘data delays’ as UK executives struggle to access and use relevant business data.

‘Playtime is over’ for GenAI

Posted 5 days ago by Phil Alsop
NTT DATA research shows organizations shifting from experiments to investments that drive performance.

GenAI not production-ready?

Posted 5 days ago by Phil Alsop
Architectural challenges are holding UK organisations back - with just 24% citing having sufficient governance to implement GenAI.

AI tops decision-makers' priorities

Posted 5 days ago by Phil Alsop
Skillsoft has released its 2024 IT Skills and Salary Report. Based on insights from more than 5,100 global IT decision-makers and professionals, the...

The state of cloud ransomware in 2024

Posted 5 days ago by Phil Alsop
Ransom attacks in the cloud are a perennially popular topic of discussion in the cloud security realm.
Talent and training partner, mthree, which supports major global tech, banking, and business clients to build job-ready teams, has revealed the...

AI innovation is powering the Net Zero transition

Posted 5 days ago by Phil Alsop
Whilst overall AI patent filings have slowed, green AI patent publications grew 35% in 2023.