Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

Mobile Test Automation Coverage Requirements — Q2 2018

DZone's Guide to

Mobile Test Automation Coverage Requirements — Q2 2018

See what operating systems are essential to cover and what major issues need to be monitored in the Android and iOS ecosystems this year.

· DevOps Zone ·
Free Resource

Discover how you can reduce your Kubernetes installation from 22 steps to 1.

Those who continuously follow my blogs and webinars know that I constantly follow the market trends, to recommend best coverage requirements.

Fragmentation of the mobile landscape isn't new, and continuously presents a challenge to mobile application developers and testers. In this post, I'll reflect the most up to date coverage recommendation for mobile and web.

Coverage Within the DevOps Pipeline and Continuous Testing

While in this blog, I'll provide the top mobile devices and tablets for iOS and Android, not all of them should be tested in each stage of the DevOps pipeline. As you progress your development, and do E2E and regression testing, your coverage from both test scenarios and target devices will obviously need to scale compared to few representative devices that you'd typically use for unit testing and basic build acceptance testing.

iOS and Android Landscape Overview

As the market is pending the GA of Android P, and next week the announcement and perhaps 1st dev preview of iOS12, it's important to be on top of the updated market stats. iOS market share is fully dominated by iOS11, followed by nearly 20% of devices and tablets that are running iOS10.3.3. About 5% are running mostly on iOS9.3.5.

As iOS12 starts to roll out with dev previews and beta versions, it's highly recommended to start catching up, understand the new features and changes to the platforms, as well as try and upgrade at least one device to the new iOS12 and validate the compatibility of your test automation code within and outside of your CI.

Android OS landscape is also divided between 4-5 major OS versions, with the new Android P that is just around the corner. ~30% of the Android devices are running Android 7.x, 25.5% are on Android 6.x, 21% of the devices are on Android 5.x. While Android 8.x is only ~5% of the market, it is a must to cover the latest GA OS version. Regarding Android 4.x (KitKat) that holds a bit more than 10% of the market share, it depends on your specific app, the geography in which your end users operate in, and of course the usage and analytics that your app/web is showing regarding this OS.

As mentioned above regarding iOS12, same goes for Android P. For Android P, Google is making this version available for the first time to leading device vendors other than Nexus/Pixel.

A recent article that was published also shows the varying reasons for iOS vs. Android application crashes (there are few debates regarding the objectiveness of the data, especially around iOS performance)

Top Android and iOS Devices to Test On (Globally)

Each geography has its own mobile usage patterns and popular devices. For that, I release almost every 1-2 quarters the Factors magazine referenced above, to guide the coverage across 17 different countries.

Globally, these are the most popular smartphones and tablets to include in your test lab.

Summary

As the market evolves, it is very important for dev and test teams to follow the above trends, and validate that their lab is fully aligned with the market from both devices and OS versions.

Get ready for Android P and iOS 12 today.

Download the Kubernetes cheatsheet to learn more about easy it is to run Kubernetes on any infrastructure with Mesosphere DC/OS

Topics:
devops ,test automation ,mobile testing

Published at DZone with permission of

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}