The client needed to evaluate the functionality and ensure the compatibility of its web applications in conjunction with various combinations of operating systems, browsers, and devices. This effort was integral to ensuring the Company’s digital experience remained consistent as its user base grew.
However, their in-house testing team was expensive and inflexible. It was unable to scale up and down to respond to increases or decreases in customer demand, resulting in missed schedules and an uneven quality of work that ill-suited a major financing organisation.
Our Centre of Excellence team engaged the client in a “shift left” model, undertaking testing alongside development and keeping them apprised of changes to applications or architecture that would be required by the development process.
To realise success, our team would have to ensure the client's technologies were highly responsive, creating an enterprise with near-zero latency. It also had to remain compatible with their existing processes, people, and infrastructure, while still attaining the desired improvements.
The Roadmap to Success
The team assembled a five-phase plan for undertaking the testing:
- Planning. The testing team analysed the work package, generated a traceability matrix, and performed the scheduling and preparation for test planning and execution.
- Test Setup. They assembled a test environment, built verification testing to ensure the stability of important functions, and prepared the test suite.
- Test Execution. The team began the testing process. Test progress was monitored using the traceability matrix. Test statuses were reviewed, and any resulting issues were reported.
- Report and Review. The team prepared peer-reviewed test execution and defect reports. This led to the creation of a consolidated defect report that allowed the identified issues to be rectified.
- Test Closure. Test summaries were reported and reviewed. The team delivered the final work package reports.
The testing team brought several capabilities to the project, including a reusable open source framework and automated test scripts that reduced compatibility testing overheads when used in conjunction with the shift left approach.
An Automated Testing process allowed the team to create hardware and software configurations that simulated live environments. They could then design and run tests within these environments to ensure applications would be compatible with the various permutations of hardware, operating systems, databases, and browser versions.
It took seven testing personnel more than six months to fully test the client's application compatibility. The team thoroughly analysed the compatibility issues, determining what alterations or additions were required to render the application compatible with the given computing environment.
The efforts and expertise of our team helped cut down on the time and resources necessary for testing. This approach, along with the results of the testing process, delivered tangible benefits:
- Automation reduced the length of each testing iteration, resulting in savings of up to 70% in both people power and associated costs
- Regression testing coverage was improved within a short time frame
- Project delivery times, as well as development and maintenance costs, were reduced through testing effectiveness and efficiency
- The creation and reuse of enterprise assets led to an improved ROI
- The total cost of technology ownership was lowered by leveraging technology investments across multiple projects
Overall, the compatibility testing process had significant, far-reaching benefits for the client. Our team brought the client a faster time-to-market for its latest mobile platforms. The client's applications are more accessible and responsive, and can function seamlessly in multiple browsers, operating systems, devices, and networks. And our compatibility testing resulted in an increased number of overall user hits, helping the client get in touch with more of its customers.