Customer
Bank Reduces Test Execution from 2 Weeks to 7 Hours
Challenge: Reducing Test Time
Before working with Perfecto, the bank’s software development lifecycle (SDLC) was a waterfall process.
However, the costs for automated testing were not only high but also low-performance quality. The regression suite of 2000 test cases took 2 full weeks to execute. The QA team shifted from HP Unified Functional Testing (UFT) to Java Selenium for mobile automation, but it was still underperforming. It resulted in a heavy dependence on a large team of manual testers to ensure mobile application quality — 4000 test cases per release.
The bank wanted to move toward a hybrid/Agile SDLC utilizing continuous integration (CI) with automated build verification and regression testing. The team turned to Perfecto to implement the customer’s digital strategy, test strategy, and implementation.
Results: Industry-Leading Digital Strategy
Within five months of adopting the Perfecto Black Belt Program, there were several game-changing achievements including:
- Automated test execution time was reduced by 75% through code review and optimization.
- The fully automated regression suite of 2000 test cases was reduced to 1500 while increasing test coverage, resulting in a lower cost of script maintenance.
- Full parallel execution reduced automated regression test time from 2 weeks to 7 hours using 5 threads per platform.
- Implementation of CI through Jenkins automated the daily execution of unit testing, build verification testing, smoke testing, and regression testing.
- QA now maintains ~70% automated coverage release to release for regression.
- The increased automation coverage has freed up the QA team to focus on expanding coverage for new features and automated unit testing for the development team.
- The Perfecto Black Belt implemented a data warehouse using MySQL and each execution is now committed to a database to allow aggregation of test execution results in real-time and comparison across specific runs or software releases.
With Perfecto, the bank maintains an industry-leading digital strategy with a high velocity and quality through an automation-enabled Agile SDLC.