Skills shortage tops list of AI challenges for IT leaders in 2024

New research from Confluent sees IT leaders share their biggest AI implementation challenges.

  • Thursday, 12th September 2024 Posted 8 months ago in by Phil Alsop

Skills shortages are the #1 challenge facing IT leaders looking to implement artificial intelligence in 2024. That’s according to research from Confluent, released ahead of this year’s BigData LDN event.

The research, which surveyed over 500 UK IT leaders, explores the top challenges facing IT departments when it comes to adopting and implementing AI.

It found that 68% of IT leaders believe “insufficient skills and expertise” are a challenge when it comes to rolling out AI. More than a quarter (28%) go as far as to say this skills shortage will pose a “major” challenge in the year ahead.

According to Confluent’s data, the UK’s top AI challenges include:

Insufficient skills and expertise (68%)

Inability to integrate data / fragmented systems (66%)

Insufficient infrastructure for real-time data processing (65%)

Poor data timeliness and quality (62%)

Addressing these challenges will be critical, with 79% of IT leaders saying they expect the demand for Generative AI and similar technologies to grow over the next two years.

As a result, many IT leaders are rethinking their approach to data, switching to more real-time processing methods. Over two thirds (68%) say that feeding AI and machine learning (ML) via real-time data streams will be an important part of their strategy in the year ahead, while 29% say it will be their “top priority”.

Commenting on the research, Richard Jones, data expert at Confluent said, “AI has been a marketing buzzword and not a technological reality for most companies — until now. But as AI becomes mainstream for businesses, many find they are still in the early stages of AI implementation. An AI skills shortage, coupled with a lack of infrastructure for real-time data processing, mean businesses are grappling with a complex, evolving technology.

“AI models need accurate, real-time data streams. With data streaming, IT teams can be incredibly agile and adapt in-line with evolving business demands. The adoption of AI can be accelerated by enabling the rapid scaling and deployment of real-time AI applications, while also tracking the data being inputted into AI models — which is fundamental for regulation.”

Technical debt stifling path to AI adoption

Posted 1 day ago by Phil Alsop
Outdated legacy technologies costing organizations the ability to innovate, money, time – and, potentially, even customers.
Data from ‘Unlocking Growth in the Mid-Market: The Node4 Report’, reveals UK mid-market leaders are taking a more pragmatic approach to public...
According to research unveiled today, one in five CIOs and CTOs at enterprise companies (21%) believe that their organisations’ road to digital...
76% of financial services firms surveyed plan to implement agentic AI within the next year.

Why most businesses aren’t yet winning with AI

Posted 4 days ago by Phil Alsop
71% of business leaders say their workforces are not ready to successfully leverage AI.
Five9 has released its 2025 Business Leaders Customer Experience Report offering analysis of CX trends shaping how global business leaders create...
Delinea has unveiled new research highlighting how ransomware attacks have continued to surge over the past year, despite fewer victims paying. Over...
96% of tech professionals view AI agents as a growing security risk, yet 98% of organisations plan to expand adoption.