Customer

Large North American Bank Reduces Test Execution from 2 Weeks to 7 Hours

Back to top

Challenge: Reducing Test Time 

Before working with Perfecto, the bank’s software development lifecycle (SDLC) was a waterfall process. 

However, the costs for automated testing were not only high but also low-performance quality. The regression suite of 2000 test cases took 2 full weeks to execute. The QA team shifted from HP Unified Functional Testing (UFT) to Java Selenium for mobile automation, but it was still underperforming. It resulted in a heavy dependence on a large team of manual testers to ensure mobile application quality — 4000 test cases per release. 

The bank wanted to move toward a hybrid/Agile SDLC utilizing continuous integration (CI) with automated build verification and regression testing. The team turned to Perfecto to implement the customer’s digital strategy, test strategy, and implementation. 

Back to top

Results: Industry-Leading Digital Strategy

Within five months of adopting the Perfecto Black Belt Program, there were several game-changing achievements including:

  1. Automated test execution time was reduced by 75% through code review and optimization.
  2. The fully automated regression suite of 2000 test cases was reduced to 1500 while increasing test coverage, resulting in a lower cost of script maintenance.
  3. Full parallel execution reduced automated regression test time from 2 weeks to 7 hours using 5 threads per platform. 
  4. Implementation of CI through Jenkins automated the daily execution of unit testing, build verification testing, smoke testing, and regression testing.
  5. QA now maintains ~70% automated coverage release to release for regression.
  6. The increased automation coverage has freed up the QA team to focus on expanding coverage for new features and automated unit testing for the development team.
  7. The Perfecto Black Belt implemented a data warehouse using MySQL and each execution is now committed to a database to allow aggregation of test execution results in real-time and comparison across specific runs or software releases.

With Perfecto, the bank maintains an industry-leading digital strategy with a high velocity and quality through an automation-enabled Agile SDLC. 

Demo Perfecto

Back to top