End-to-End Testing for a Mobile Banking App Rated 4.8 on Google Play

Summary

A commercial bank serving small and medium businesses launched a mobile banking app to let customers pay and manage their money on the go — and needed it to work flawlessly across a highly fragmented mobile landscape. INNERLUXES has run the app's testing for more than five years, combining device-coverage testing across the customers' most popular iOS and Android devices with Agile beta testing of every release and a focused regression suite. The result is a multi-award-winning app that runs smoothly across a wide range of devices and is rated 4.8 on Google Play.

About the Client

The Client is a reputable commercial bank focused on supporting small and medium businesses.

A Complex, Highly Responsive Banking App Across Fragmented Mobile Platforms

To attract new customers and improve the experience of existing ones, the Client decided to launch a mobile banking app for payments and fund management. To reach a wide audience, the bank built it for both major platforms (iOS 9.3.5+ and Android 4.0.1+), which meant testing against highly fragmented operating systems and the many Android devices — each with its own peculiarities — on which the app would run.

To give users an experience close to visiting a physical branch, the app needed complex functionality and had to react quickly to changing conditions, such as changes in legislation or a revised payment system. That called for swift, precise testing focused on the most risk-prone features and areas of the system.

Device-Coverage Testing and Agile Beta Releases

To tackle fragmentation and assure proper coverage, the testing team focused on the 20+ devices most popular among the bank's customers, running at least iOS 9.3.5 or Android 4.0.1, which addressed the vast majority of users and let the team troubleshoot the issues affecting them in good time. The work relied on close collaboration between the INNERLUXES testers and the bank:

• Agile beta testing. Given how complex and responsive the app had to be, ordinary functional testing was not enough; instead, each stable release candidate went through beta testing. The process was fully transparent to the Client — test scenarios were shaped by comments from employees across various bank departments — and INNERLUXES and the bank's staff tested each release for one to two days before launch to explore it in detail.
• Focused regression testing. To preserve the app's leading position in its local mobile banking market, the team built a regression scenario of 89 critical test cases, which markedly cut testing time and let the app be updated swiftly and seamlessly.

A Multi-Award-Winning App Rated 4.8 on Google Play

The engagement has run for more than five years. The joint efforts of the developers, the bank, and the testing team produced a high-quality, easily updatable app that runs seamlessly across a wide range of iOS and Android devices — including wearables — and provides a secure environment for transactions, covering most of the functions available at a physical branch. The app has won numerous awards from a local banking-industry portal:

• Silver in "Android Mobile App 2014".
• Gold in "Best Mobile Banking for iOS" (2015, 2016, and 2017).
• Gold in "Best Mobile Banking for Android" (2015, 2016, and 2017).
• Gold in "Best Mobile App" (2015 and 2016).

In the 50,000-100,000 download range, the app is rated 4.8 on Google Play, and its success has led the Client to continue its cooperation with INNERLUXES.

Technologies and Tools

Atlassian JIRA.