Testing times?

Report provides an unprecedented look at how Fortune 500 and equivalent companies test the software that their business - and the world - relies on.

  • Wednesday, 14th April 2021 Posted 3 years ago in by Phil Alsop

Tricentis has published its report, “How the World’s Top Organizations Test”, analysing how industry leaders test the software their businesses rely on. For this first-of-its-kind report, Tricentis collected data from 100 Fortune 500 (or global equivalent) organisations and major government agencies across Europe, the Americas, and Asia-Pacific.



Every business is becoming a digital enterprise, and the ability to rapidly release reliable applications is now a core strategic advantage. With today’s near-continuous release cycles, enterprise organisations must ensure that each update adds value and meets the demand for extreme reliability. Software testing has to accommodate a complex application stack that involves an average of 900 applications, and single transactions touching 82 different technologies without any downtime. Just an hour of downtime at the enterprise level can cost an organisation between $500K to $1M.


“Software testing is a complex task that has an incredible amount of approaches which has made it underestimated and underappreciated by organisations for too long,” said Wolfgang Platz, founder and chief strategy officer at Tricentis. “However, many top organisations have transformed testing into a catalyst for digital transformation. We hope that our report will assist other organisations in doing the same.”


Currently, testing applications is the number one source for delivery delays. Testing costs consume, on average, 23-25% of overall IT spend. Automation is not widely implemented because there isn’t consistent and reliable access to data that large organisations need to enable automation.

 

Within the report, organisations are empowered with benchmark data on how to speed up application testing, reducing risk and costs, and utilise testing for digital transformation initiatives.  The report outlines:

     How leaders and laggards differ on key software testing and quality metrics

     Where most organisations stand in terms of CI/CD integration, test environment strategy, and other key process elements

     What test design, automation, management, and reporting approaches are trending now

     Organisations’ top priorities for improving their testing in 2021

 

For example, the analysis found an average test automation rate of 39%, but high false positives (22%), low-risk coverage (25%), and shockingly slow testing cycles (23 days) overall.