Enterprises can expand use of emergent data sources

BMC has released findings and analysis from its survey and corresponding report, Putting the “Ops” in DataOps: success factors for operationalising data. This second annual survey of IT decision-makers provides insights into how enterprises can assess and enhance their data maturity strategy to use data for competitive advantage. A complementary data maturity assessment also allows companies to evaluate their status and provides suggested next steps.

  • Monday, 29th July 2024 Posted 10 months ago in by Phil Alsop

As organisations strive to capitalise on their ever-growing data trove to scale their operations and improve business outcomes, the study found that only 17 percent of data ingested or landed consists of emergent data types, and only 9 percent of that data is processed or analysed. This signals a significant opportunity to benefit from emergent data types critical for initiatives like generative AI, LLMs, FinOps, and sustainability.

To help enterprises better understand and assess their data and DataOps strategy, the study defined four maturity levels, including:

Developing – discovery phase with strategies in their infancy, and practices and architecture not closely aligned to business outcomes.

Functional – growth phase with strategies primarily developed and some high-priority practices and architecture linked to business outcomes.

Proficient – adolescent phase representing a fully established strategy with nearly all practices and architecture linked to critical business outcomes.

Exceptional – innovation phase with a perpetually optimised strategy, practices, and architecture that generates competitive differentiation and business value.

DataOps strategy is closely aligned with data management maturity. Of those respondents with exceptional data management maturity, 27 percent stated they use DataOps methodologies across their organisation to support all data-driven activities. In comparison, those with proficient maturity levels reported 19 percent, and functional and developing levels stated 15 percent and 10 percent, respectively. Even among organisations with exceptional data maturity, only 41 percent report having “high maturity” for data pipeline and application workflow orchestration functions.

Higher data management and DataOps maturity are linked to higher reported adoption and success with data-driven activities. 75 percent of those with mature practices have a chief data officer, while only 54 percent with less mature practices do.

Challenges obstruct flow of data

Multiple challenges continue to impact the flow of data in businesses, including those related to people, processes, and technology. These include a lack of skills (48 percent), human error and mistakes (43 percent), limitations on scalability (40 percent), and a lack of technology automation (43 percent). A lack of automation can exacerbate a lack of skills, while an appropriate use of automation can amplify skills already available.

“AI and data are in a cosmic dance, and data challenges are increasing dramatically in the AI era,” said Ram Chakravarti, chief technology officer at BMC. “This study highlights how organisations with mature data practices can achieve better business outcomes. Implementing DataOps methodologies to enhance collaboration and operational efficiency, maintaining high data quality through pragmatic investments, and developing robust data pipeline orchestration systems can help unlock value at scale.”

BMC commissioned 451 Research, part of S&P Global Market Intelligence, to conduct the survey in late 2023, sourcing insights from 1,100 IT, data, and business professionals from large enterprises in diverse global regions across multiple industries in eleven countries.

58% of organizations have observability programs, but 42% still don’t trust their AI models.

Public sector embraces GenAI

Posted 3 days ago by Phil Alsop
GenAI is expected to improve productivity, efficiency, and automation, with long-term ROI for Public Sector organisations.
Survey of 500 tech leaders shows companies are moving fast on AI plans while struggling with scale, integration, and compliance issues.
Insecure cloud configurations create widespread risk, highlighting the urgent need for unified cloud exposure management.

IT teams are losing visibility

Posted 3 days ago by Phil Alsop
New industry report highlights growing SaaS waste, persisting audit costs and evolving priorities as ITAM teams navigate increasing financial...

'Alarming' state of software engineering

Posted 3 days ago by Phil Alsop
Harness, the AI DevOps Platform™ Company, has released a new study revealing a growing disconnect between the promise of engineering excellence and...
New Endava research shows 93% want rapid adoption – even as infrastructure struggles to keep up.
According to a new report from Ericsson, 87 percent of business leaders surveyed in Europe believe 5G connectivity is required to accelerate R&D...