Mobile mayhem?

As organizations embrace digital transformation, application quality is an increasingly important strategic focus but many are still falling behind in mobile testing and effectively demonstrating its ROI.

  • Friday, 13th September 2013 Posted 11 years ago in by Phil Alsop

Capgemini and Sogeti have released the findings of the fifth World Quality Report. The report, published in conjunction with HP, reveals that application Testing and Quality Assurance (QA) now accounts for almost a quarter of IT spend, as many organizations undergo the process of digital transformation and reliable software applications become increasingly critical to their operations and reputation.


As the importance of application quality increases, average spending on QA as a percentage of total IT budget has grown from 18 percent in 2012 to 23 percent in 2013. However, many organizations still struggle to demonstrate the true value of their testing function to the business. In addition, despite mobile being a primary channel of engagement for both employees and customers, almost half (45 percent) are still not adequately validating the functionality, performance and security of mobile applications and devices. Although the report highlights a rapid rise in mobile testing (from 31 percent in 2012 to 55 percent in 2013), over half of those surveyed (56 percent) cite a lack of specialized methods as the biggest barrier to mobile testing, and an additional 48 percent report that they still lack mobile testing experts.


With organizations increasingly reliant on IT systems and applications to support their core business functions without interruption, many are now taking a more strategic, centralized and business-led approach to QA. Compared to 8 percent in 2012, this year, over a quarter (26 percent) of those surveyed have consolidated their QA function across projects, lines of business or the whole company. Nearly one in five (19 percent) reported having a fully operational Testing Center of Excellence (TCOE) in place to serve the needs of the business, up from just 6 percent last year, as testing becomes a much more industrialized process within organizations. In addition, the report highlights growing demand for business and domain knowledge among testers, with nearly two thirds (63 percent) of executives surveyed saying that an understanding of the business is an important capability in their testers as QA functions seek to align more with strategic business priorities.


“The findings from this year’s research have again highlighted the growing strategic importance of Testing and Quality Assurance, along with the critical contribution it makes to ensuring operational business targets are achieved and customer expectations are met,” said Michel de Meijer, Leader Global Service Line Testing Capgemini & Sogeti. “Increasingly, technology applications provide the main interface between businesses and their customers - often delivered across multiple channels and devices, with end-users becoming less and less tolerant of functional errors, poor performance or known security vulnerabilities.”


As QA continues to rise in strategic importance for many organizations, this year’s study highlights how some businesses are pioneering the value QA brings to business as part of a more strategic approach, capturing metrics related to wider business ROI, such as the contribution of QA to reduced time to market (45 percent) or cost savings by preventing defects (39 percent). However, many organizations still do not demonstrate the business value of QA to the wider business, as they still mainly capture and report operational information such as the number of defects found (73 percent) or cost per test case (55 percent). Additionally, 45 percent of those surveyed are involving testing leads too late in the delivery process to influence application quality beyond just finding and fixing defects.


For those organizations struggling to improve the maturity of their in-house QA function, the outsourced Managed Testing Services (MTS) model is an emerging option, with 12 percent turning to MTS providers to bring not just labor, but specialized knowledge of testing processes and a full array of tools to test with maximum efficiency to demonstrate ROI effectively. For example, when it comes to outsourcing their mobile application testing, the capacity to test across a wide range of platforms and devices is rated as the most important capability (60 percent), reflecting the need to ensure coverage across a broad variety of environments which many internal QA functions cannot deliver.


“With the research findings showing that almost a quarter of IT budgets are now being allocated to Testing and QA activities, measuring the ROI to the business based on financial as well as IT operational metrics is becoming ever more important,” said Matt Morgan, vice president, Product Marketing, Software, HP. “For organizations to take a more strategic approach to testing and QA, they need to have better visibility and reporting to illustrate both operational and business information value.”