HomeTesting Concepts

Mobile Testing Made Easy Tutorial – A Complete and Detailed Guide from Scratch

Mobile Testing Made Easy Tutorial – A Complete and Detailed Guide from Scratch

Do you want to learn Mobile Testing concepts in detail and from scratch.

Then you are at the right place.

This article will clear almost all questions/doubts which are stopping you from learning Mobile Testing along with the terminologies used while performing  Mobile Testing.

The below are the different things explained in this article on Mobile Testing:

  1. What is a Mobile Application?
  2. What is Mobile Testing?
  3. What are the Mobile Devices and their types?
  4. What are the different Mobile Operating System platforms?
  5. Major Mobile Operating System platforms and their popular Mobile Devices
  6. Different types of Mobile Applications
  7. Mobile App Testing versus Mobile Device Testing
  8. Screen Orientation
  9. Mobile Gestures
  10. Splash Screen
  11. Real Devices versus Emulators/Simulators
  12. Android SDK (Emulator)
  13. iOS Simulator (Simulator)
  14. Mobile App Testing Types
  15. Mobile Test Automation and Tools
  16. Using Google Chrome Dev Tools for Mobile Testing
  17. Form Factor
  18. Using Screenfly Tool for Mobile Testing
  19. Taking Screenshots in Different Mobile Devices
  20. Using GenyMotion Android Emulator for Mobile Testing
  21. App Extensions of Major Mobile OS Platforms
  22. Kobiton Paid Tool for Mobile Testing on Real Devices
  23. Other tools for Mobile Testing
  24. Mobile Network Technologies


What is a Mobile Application?

Application which is developed for working on any supported mobile device is known as Mobile Application.

Now a days, everyone carries a Smart Phone in their hand.

And few of the mobile applications we regularly use in our Smart Phones are Facebook App, Whatsapp App, Amazon Shopping and many more.

Mobile Apps

Here in the above image, Smart Phone is the Mobile Device.

As you have now understood the Mobile Application and Mobile Device terminologies, you can understand the below Mobile Testing definition.



What is Mobile Testing?

Mobile Testing (Mobile Application Testing) is the testing performed on the Applications that are developed for running on the supported mobile devices.



What are Mobile Devices and their types?

When we have to start testing a Mobile Application Testing project, we have to first find-out all the mobile devices on which this mobile application has to work.

i.e. Supported mobile devices list on which the Mobile Application has to be tested will be generally provided by the client.

The below are the different types of possible Mobile Devices, on which we have to perform the Mobile Application Testing:

  1. Smart Phones
  2. Tablets

Smart Phone and Tablets

In some cases, we can be asked to test on the Laptop-Tablet hybrid devices like Surface Pro, where the keypad from the Laptops can be detached for using them as Tablets.

And also, from Windows 8.1 onwards, we can install the Mobile Applications in our Microsoft Windows Laptops too. If the Mobile Application has to be supported and work on the Laptops having Windows 8.1 and above OS, then we have to install them in our Mobile Testing Devices List.



What are the different Mobile Operating System Platforms?

There are many Mobile Operating System Platforms, but below are the major players in the market:

  1. Android
  2. iOS

All the other Mobile Operating System Platforms have the negligible market share.

Click here to find the market share of different Mobile Operating Systems.

Hence we will be asked to mostly perform Mobile Application Testing on the Mobile Devices having Android and iOS Operating systems.

The following are the different Mobile Operating System Platforms:

  1. Android
  2. iOS
  3. Windows
  4. BlackBerry
  5. KaiOS (Linux based OS)
  6. Symbian
  7. Series 40
  8. Others


Major Mobile Operating System Platforms and their popular Mobile Devices

As Android and iOS have the major market share in Mobile Operating System platforms, the below are the different Mobile Devices we perform Mobile Application Testing on:

Android OS Based Mobile Devices

  1. Android Smart Phones
  2. Android Tablets

Android Phone

Before we perform any Mobile Application Testing, we have to find-out the operating system platforms, mobile device types and the device brands which are supported by the Mobile Application to be tested.

There are many brands (companies) which build these Android Mobile Devices like below:

  1. Samsung
  2. Xiaomi
  3. OnePlus
  4. Oppo
  5. Vivo
  6. Lenovo
  7. Nokia
  8. Techno
  9. LG
  10. huawei
  11. Sony
  12. Google
  13. HTC
  14. And many others

Click here to find out the different brand which are selling the Android OS based Mobile Devices.

Apart from the Brands, we have to also find-out the Android OS versions needed for testing our Mobile Application.

So, the below are the different versions of Android OS which have been released into the market so far:

  1. Android 1.5 (Cupcake) – Older version
  2. Android 1.6 (Donut)
  3. Android 2.0 (Eclair)
  4. Android 2.2 (Froyo)
  5. Android 2.3 (Gingerbread)
  6. Android 3.0 (Honeycomb)
  7. Android 4.o (Ice Cream Sandwich)
  8. Android 4.1 to 4.3 (Jelly Bean)
  9. Android 4.4 (Kitkat)
  10. Android 5.0 (Lollipop)
  11. Android 6.0 (Marshmallow)
  12. Android 7.0 (Nougat)
  13. Android 8.0 (Oreo)
  14. Android 9.0 (Pie)
  15. Android 10 (10) got released in Sep 2019
  16. Many more versions may come in the future

Click here to find the current list of Android versions which are released into the market.

So, while performing the Mobile Application Testing, we should be clear about the below things:

  1. On which Mobile Operating System Platform, we need to perform the testing
  2. On which Mobile Device Type, we need to perform the testing
  3. On which Mobile Device Brand, we need to perform the testing
  4. On which Android version, we need to perform the testing

Example: Samsung Android OS 9.0 Tablet (Here, Samsung is the Device Brand, Android OS is the OS Platform, 9.0 is the Android OS Version (Pie) and Tablet is the Device Type)

iOS OS Based Mobile Devices

Apple is the only brand which is selling the iOS OS Based Mobile Devices:

  1. iPhone (Smart Phone)
  2. iPad (Tablet)

iOS iPhone and iPad

Note: We can also install the Mobile Applications in the Mac (MacOS Laptop) and Apple TV, hence there may be requirements for you to perform Mobile Application Testing in the Mac Laptops and Apple TV to0.

Apart from the above device type, we have to find-out the iOS OS versions on which the Mobile Application Testing has to be performed.

The below are the different iOS OS versions released into the market so far:

  1. iPhone 0S Version 1 (Supported Devices – iPhone Smart Phone)
  2. iPhone OS Version 2 (Supported Devices – iPhone Smart Phone)
  3. iPhone OS Version 3 (Supported Devices – iPhone Smart Phone and iPad)
  4. iOS Version 4 (Supported Devices – iPhone, iPad and others)
  5. iOS Version 5 (Supported Devices – iPhone, iPad and others)
  6. iOS Version 6 (Supported Devices – iPhone and iPad)
  7. iOS Version 7 (Supported Devices – iPhone and iPad)
  8. iOS Version 8 (Supported Devices – iPhone and iPad)
  9. iOS Version 9 (Supported Devices – iPhone and iPad)
  10. iOS Version 10 (Supported Devices – iPhone and iPad)
  11. iOS Version 11 (Supported Devices – iPhone and iPad)
  12. iOS Version 12 (Supported Devices – iPhone and iPad)
  13. iOS Version 13 (Supported Devices – iPhone and iPad)
  14. More versions will be coming in the future

Click here to find the complete list of iOS OS Versions released into the market

Also, we may be asked to test the iPhone Smart Phone Device or iPad Device having specific model.

The iPhone Smart Phone Device has been released into the Market in the below different models:

  1. iPhone (Oldest Model)
  2. iPhone 3G
  3. iPhone 3GS
  4. iPhone 4
  5. iPhone 4s
  6. iPhone 5
  7. iPhone 5c
  8. iPhone 5s
  9. iPhone SE
  10. iPhone 6 Plus
  11. iPhone 6
  12. iPhone 6s Plus
  13. iPhone 6s
  14. iPhone 7 Plus
  15. iPhone 7
  16. iPhone 8 Plus
  17. iPhone 8
  18. iPhone X
  19. iPhone XR
  20. iPhone XS Max
  21. iPhone XS
  22. iPhone 11
  23. iPhone 11 Pro Max
  24. iPhone 11 Pro

Click here to find the complete list of iPhone Models released into the market so far.

The iPad Device has been released into the Market in the below different models:

  1. iPad (Oldest Model)
  2. iPad 2
  3. iPad 3
  4. iPad 4
  5. iPad 9.7 inch (5th Generation)
  6. iPad 9.7 inch (6th Generation)
  7. iPad 10.2 inch (7th Generation)
  8. iPad Air
  9. iPad Air 2
  10. iPad Air (3rd Generation)
  11. iPad mini
  12. iPad mini 2
  13. iPad mini 3
  14. iPad mini 4
  15. iPad mini (5th Generation)
  16. iPad Pro 12.9 inch
  17. iPad Pro 9.7 inch
  18. iPad Pro 10.5 inch
  19. iPad Pro 12.9 inch (Second Generation)
  20. iPad Pro 11 inch
  21. iPad Pro 12.9 inch (Third Generation)
  22. More may come in future

Click here to find the complete list of iPad Models released into the market so far.

There is a latest version of OS used by Apple in iPad Models know as iPadOS.

iPadOS is the successor of iPhone and iOS OS versions.

The latest version of iPadOS released as of Jan 28, 2020 is iPadOS 13.3.1 and more versions of these iPadOS versions are going  to be released in the near future.

Click here to find the list of iPadOS versions getting released into the market.



Different types of Mobile Applications

Mobile Applications can be categorized into the below types:

  1. Mobile Website
  2. Web Apps
  3. Native Apps
  4. Hybrid Apps

Mobile Website

Mobile Websites are the general web sites that are built to look good in the mobile devices.

Example: www.qafox.com which is shown in the below screenshot

Mobile Website

As part of testing, we have to test whether the mobile version of the website is displaying and working properly in the supported mobile devices (Smart Phone and Tablets).

i.e. We have to open the websites which are enabled for mobile browsing using the browsers provided in the supported mobile devices (i.e. Smart Phone and Tablets) and then test them.

As part of this testing, we also test the responsiveness of the Mobile Websites (i.e. All the website content should fit into the supported mobile device screen).

We don’t have to install any application to open this Mobile Websites, as they can be directly browsed using the browser available in  the mobile devices.

We can call these Mobile Websites as Mobile Web or Mobile Enabled Web (MEW) too.

Web Apps

Let’s go through the below points for understanding what exactly the Web Apps are:

  1. Mobile Web Apps are simple mobile applications
  2. We need to install them on the mobile devices similar to other mobile applications
  3. Web Apps run on the mobile browsers, while the Mobile Apps run on the mobile devices
  4. Web Apps displays the information present on the Web Browser, on a Mobile App look a like screens
  5. While the Web Browser has the address bar to display the URL of the website, Web App simply looks like Mobile App without any address bar showing any application URL

Let’s make the above explanation practical, by following the below steps for installing a Web App on a Mobile Device:

  1. Go to Google Play Store on your Android Device (Or App Store in Apple Devices)
  2. Search for ‘W3Schools Online Tutorials’ and install the App on your Mobile Device
  3. After installing the ‘W3Schools Online Tutorials’ Web App on your Mobile Device, open it and compare it with the https://www.w3schools.com/ which is opened in your Laptop/Desktop Web Browser.
  4. Observe that the ‘W3Schools Online Tutorials’ Web App on your Mobile Device looks same as https://www.w3schools.com/ in your Laptop, except the Mobile App like Display without having any URL/address-bar.

Web App

Native Apps

Native Apps are the Mobile Apps which are developed for specific device platforms using the device platform specific native programming languages.

As they are build to run on specific platforms, they are very fast and interactive compared to other Mobile Types.

Native Apps

As Native Apps run on the Mobile Devices, they can access and use the mobile devices specific hardware and software like Camera, Contact List, GPS etc.

Few Native Apps comes by default in our Mobile Devices and other required Native Apps can be downloaded from the device Play Store or App Store.

Examples for Native Apps: LinkedIn, Facebook, Google Maps etc .

Hybrid Apps

Hybrid Apps are the combination of Native Apps and Web Apps.

Developers use HTML, CSS and JavaScript for developing Hybrid Apps, which are the technologies that are common across multiple platforms.
Hybrid AppsThe single Hybrid App can be developed to work for multiple cross platforms, which there by reduces the development efforts by overcoming the need for developing separate Apps for different devices and OS platforms.

As the native programming languages are not used for building the Hybrid Apps, these Hybrid Apps are slower when compared to Native Apps.

Hybrid Apps are nothing but the Web Apps which are wrapped inside a Native App layer, the Native App layer of Hybrid Apps connect the web browser capabilities to the mobile platform capabilities.

As the Hybrid Apps are the combination of Native Apps and Web Apps, they run on the Mobile Devices and can use the mobile devices specific hardware and software like Camera, Contact List, GPS etc. similar to Native Apps.

Hybrid Apps can be installed on the mobile devices from their Play Store or App Store.

Examples for Hybrid Apps: Gmail, Uber, Sworkit etc.



App Testing Versus Device Testing

Mobile Testing can be categorized into the below two types:

  1. Mobile App Testing
  2. Mobile Device Testing

Mobile App Testing is related to testing the working of the given Mobile App by installing it in the supported Mobile Devices.

Where as Mobile Device Testing is related to testing of the Mobile Device itself.

Sometimes, Device Testing is also called as Mobile Testing.

Hence it is better to call App Testing as Mobile App Testing instead of Mobile Testing.

Click here to find more about Device Testing.



Screen Orientation and Mobile App Testing

While testing the Mobile Apps, we rotate the mobile device screen from Portrait mode to Landscape mode to check whether the mobile application is working properly in different supported modes.

The Mobile App if supported in both Portrait and Landscape mode, on changing the modes the application will rotate itself to adjust itself to the rotated mode.

Screen Orientation

We need to find out from our Clients whether the Mobile Application under test has to work in both Portrait and Landscape modes. If the client requirements are to test the application in both modes, then we have to test the working of the application in portrait and landscape modes.

And if the Mobile application is only supported in Portrait mode, still we need to check in Landscape mode to see the Mobile application is not rotating to adjust itself to the Landscape mode.

In order to test the Mobile App in different modes, we need to change the ‘Screen Rotation’ option in the Mobile devices as shown below:

Mobile Devices Rotation Options



Mobile Gestures

Mobile Gestures are the different ways of movements made by the user on the mobile screen for interacting with the mobile device interface.

Having the knowledge of different mobile gestures will help you in writing the test cases in a better way or communicating the things to others in a better way.

The below are the different Mobile Gestures we generally use:

Tap

Instead of clicking on a button or option, in Mobile App Testing we Tap our finger on the mobile app screen for selecting and displayed option.

Tap

Image Credit: Touch Gesture Reference Guide

Example: Open your smart phone and Tap on any application to launch/open it.

Double Tap

Double Tap is a gesture, where we Tap on the mobile device screen twice.

Double Tap

Example: Open any article in your mobile browser which displays some text and Double Tap on any word displayed in the article to get Copy, Share and other options (Try in Android Phone).

Flick

Flick is a gesture, where we place a finger on the screen and quickly swipe it in any required direction for faster scrolling (horizontally or vertically).

Flick

Example: Lets say you have hundreds of contacts in your mobiles, open the Contacts in your mobile and quickly swipe up or down with your finger for faster scrolling through your contacts.

Pinch

Pinch is a gesture, where we place two fingers on the screen and move them together for zoom in purposes.

Pinch

Example: Open Google Map, put your fingers on the displayed map and drag these two fingers together to zoomin the map. We can also try this with any image on our smart phone.

Spread

Spread is a gesture, where we place two fingers on the screen and move them away from each other for zoom out purposes.

Spread

Example: Open Google Map, put your two fingers on the displayed map and drag these two fingers away from each other to zoom-out the map. We can also try this with any image on our smart phone.

Long Press

Long Press or Press is a gesture, where we touch the screen and hold it for a period of time.

Press

Example: Touch an App on the mobile screen and hold it for a period of time, until you get options to uninstall the app.

We can also try this for sending voice message in whatsapp app, where instead of typing text in the text box, we will touch and hold the mike icon beside the text box to turn on the voice recording mode in whatsapp.

Swipe

Swipe is a gesture, where we touch the screen and move the finger without releasing from the screen in any required direction.

Swipe

Example: In any Android mobile, touch the screen on the top and  move the finger without releasing from the screen in the downwards direction to open the Notifications.

Other Gestures

Apart from the above explained commonly used gestures, there are many more gestures available in different mobile devices and platforms.



Splash Screen

When you launch any mobile application, most of the mobile applications will show us a Splash Screen.

Splash Screen

For example, launch a Facebook App on your mobile. Before you see any facebook functionality in the App, a Splash Screen will be displayed for a short span of time.

You can see the Splash Screen for more time, when you launch the same facebook app for the first time in your mobile device.

Splash Screen is also called as Launch Screen or Startup Screen.

The below are the different reasons for the Mobile Apps for displaying a Splash Screen:

  1. Branding Showcase
  2. Displaying the Splash Screen till the actual Application completes processing and loads


Real Device versus Emulators/Simulators

As most of the mobile applications developed these days, has to work across a huge number of mobile devices types, mobile OS platforms, OS Versions and other differences.

It will be a huge cost burden for the Testing Service Providers to arrange all the supported mobile devices for performing mobile testing on the real devices.

How to overcome this cost burden?

The answer for this is to use the Emulators and Simulators in place of real devices.

So, what are Emulators and Simulators?

Mobile Emulators and Simulators are nothing but the Software Programs which will help us in simulating the features of the real devices which are actually required for our mobile testing.

EmulatorSimulatorMobile

Though we overcome the cost burden of procuring the real mobile devices by replacing them with the Emulators and Simulators, we still have to face the below challenges with the Emulators and Simulators:

  1. Emulators and Simulators are slow when compared to real mobile devices. We have to get used to it while testing the mobile apps on them.
  2. At the end they are not real and they are just the simulation of the real devices, so in very rare cases they may result in false results. Hence the results may not be so accurate as the results we get from testing on the real mobile devices.
  3. Cannot simulate the real device battery
  4. Cannot simulate the real device camera
  5. Cannot simulate the real device memory
  6. Cannot simulate the interruptions like incoming calls, notifications and messages
  7. And many others

Because of the above challenges that we have to face by testing the mobile applications on Emulators/Simulators, we have to use at-least few possible real devices which we can procure in our budget and use the Emulators/Simulators when we are going out of our budget. This way, we can speed up our testing, use the real features of the device which cannot be simulated and improve the accuracy of the test results.

Before moving a head, we need to know that the Emulators are different from Simulators.

I will explain the difference between Emulators and Simulators at a later point of time in this article.

Now, lets find out the Software Programs that are there in the market for Emulating and Simulating the Mobile Devices.

The below are the two popular Emulators/Simulators that are there in the market:

  1. Android SDK (Emulator)
  2. iOS Simulator (Simulator)


Android SDK (Emulator)

Android SDK (Emulator) is for mimicking Android Apps on Android OS Virtual Devices.

In order to use Android SDK (Emulator), lets download, install and configure Android Studio (which includes Android SDK).

Follow the below articles for downloading, installing and configuring Android Studio in your Windows machine:

    1. Downloading and Installing Android Studio
    2. Configuring Android Studio
    3. Launching Android Studio

Once the Android Studio is downloaded, installed and configured in your Windows machine, follow the below articles for creating, configuring and Launching the Android Emulator.

  1. Creating an Emulator in Android Studio
  2. Configuring Emulator in Android Studio
  3. Launching the above created and configured Android Emulator

You can also go through the Android Studio Emulator option at the below link:

  1. Android Studio Emulator Options


iOS Simulator (Simulator)

iOS Simulator is for making iOS Apps on iOS OS Device like iPhone, iPad and others.

We need a Mac computer to experience this simulator.

Follow the below steps for using iOS Simulator:

  1. In Mac computer, download and install Xcode from the App store.
  2. Go to Applications, open Xcode > Contents > Developer > Platforms > iPhoneSimulator.platform > Developer > Applications and select iOS Simulator
  3. Simulator for iPhone will be launched by defualt
  4. Now select, Mac Hardware Menu on the top and select Device > iPad and observe that the iPad will be launched.

Click here to watch the above steps in a video.

Emulator versus Simulator

In the above sections, I have explained how to use Android Emulator and iOS Simulator.

As you got some idea about the famous Emulators and Simulators we use for testing Mobile Apps, now lets understand the differences between the Emulator and Simulator from the below points:

  1. Emulators and Simulators have small differences, hence these words are used interchangeably.
  2. Simulators only mimics the activity/behavior of the Mobile Devices, without mimicking the original mobile device. Its just like a ‘Flight Simulation’ program which only makes you believe that you are going from here to some place on flight, but in reality you are not actually moving.
  3. Emulator on the other hand is like a Virtual Device which works like the original mobile device.

But at the end, despite of these differences between these simulators and emulators, we use both of them for testing our Mobile Apps when real mobile devices are not in place.



Mobile App Testing Types

There are different types of Testing which need to perform as part of Mobile App Testing.

Mobile App Testing Types

The below are the different types of Testing that we need to perform on the Mobile App:

Functional Testing

Functional Testing is performed to check whether the Mobile Apps are working as per the requirements specifications (Verification) and end user needs (Validation)

Compatibility Testing

Compatibility Testing is performed to test whether the Mobile App is working on all the supported Mobile Device Models, OS Platforms and Versions.

Compatibility Testing plays a key role in Mobile App Testing, as there are many Mobile Devices in the market on which the developed Mobile App has to work.

As there are huge number of possible Mobile Devices on which our Mobile App has to be tested, we need to create a Test Matrix of supported Mobile Device Models, OS Platforms and Versions.

And also we need to prioritize the supported Mobile Device Models, OS Platforms and Versions and perform the high priority things first.

Usability Testing

As part of Usability Testing the Mobile App, we need to check the below:

  1. How easy it is the App functionality for the user to understand and use without any confusions.
  2. User is able to navigate through all the App Screens in a smooth manner without any confusions.

UI Testing

Testing the GUI of the Mobile Application to check whether it is according to the requirements and end user needs.

Things to verify as part of Mobile App UI Testing

  1. All the UI elements on the Mobile App are aligned properly
  2. All the UI elements are in proper size
  3. All the error messages are displayed properly on the Mobile App Screen with correct font color and font size
  4. All the scroll bars (horizontal or vertical) are displaying correct on the Mobile App Screen when required
  5. All the text on the Mobile App screens is readable
  6. All the text on the Mobile App screens has the required font
  7. All the text on the Mobile App screens is fitting into the screen
  8. All the text on the Mobile App screens is not overlapping with other UI elements.
  9. All the text on the Mobile App screens is not trimmed out due to less space on the screen
  10. All the text on the Mobile App screens is properly aligned
  11. All the text on the screen has the correct font color
  12. All the images displayed on the Mobile App screen are displayed with good clarity
  13. Checking whether the text is spelled correctly on the Mobile App Screens
  14. Testing the Mobile App on different screen resolutions for finding any UI issues
  15. Testing the Mobile App on the different supported Mobile Device Models, OS Platforms and versions with an intention of finding the UI issues.
  16. Testing whether the Mobile App screens has attractive GUI
  17. Testing the color consistency of the different UI elements across the Mobile App screens
  18. And many more

Installation Testing

Installation Testing is performed to check whether the User is able to install and uninstall the Mobile Apps smoothly without any problems.

Things to verify as part of Mobile App Installation Testing:

  1. Installation of Mobile App needs to be tested across various supported Device Models, OS Platforms and Versions.
  2. Checking whether all the instructions are provided properly during Mobile App Installation
  3. Stopping the Mobile Application Installation process in between, should take back the system to the clear state.
  4. Installing the latest version of the Mobile App on the existing older version of the same Mobile App and check how the situation is handled
  5. Forcefully stop the Mobile App Installation and check how the situation is handled
  6. Install the Mobile App using default options
  7. Install the Mobile App using customized options
  8. Install the Mobile App, while the high RAM using application is running the Mobile Device.
  9. Check how the Mobile App Installation handles the errors, if they occur during the App Installation
  10. Check how the Mobile App Installation is changing the registry files in the Mobile Device
  11. Install the Mobile App while a similar other Mobile App is already running on the Mobile Device
  12. Install the Mobile App when there is insufficient RAM to allocate in the Mobile Device
  13. Installing the Mobile App to check the Disk Space Availability on the Mobile Device
  14. Install the Mobile App to check how much Disk Space is consumed by the Installed Mobile App
  15. Install the Mobile App where there is insufficient Disk Space available in the Mobile Device
  16. Install the Mobile App when the Mobile Security Options are enabled and Mobile Security Firewall is turned on
  17. Install the Mobile App by connecting to internet through WIFI
  18. Install the Mobile App by connecting to internet through 4G LTE network
  19. Install the Mobile App by connecting to internet through 4G network
  20. Install the Mobile App by connecting to internet through 3G network
  21. Install the Mobile App by connecting to internet through 2G network
  22. Check what happens when your internet connection goes out of reach during Mobile App installation
  23. Check what happens when your internet connection goes out of reach for a while and re-establishes connection during Mobile App Installation
  24. Check what happens when your internet connection switches between WIFI, 4G, 3G, 2G and others during Mobile App Installation
  25. Install the Mobile App when your Mobile Device is connected to multiple networks say WIFI, 4G at the same time.
  26. Install the Mobile App at different internet speeds (i.e. check the mobile app installation at very low speed to very high speed)
  27. Check the time taken for installing and uninstalling the Mobile App on different supported Mobile devices
  28. Checking the logs recorded in the log file during Mobile App Installation
  29. Install the App updates on the existing Mobile App on your mobile device to check whether the Mobile App is getting updated properly
  30. Testing the Mobile App Installation during interruptions like Phone Call, SMS, Notifications, Low Battery etc.
  31. Checking the Mobile App Installation in SD card of the Mobile Device
  32. Checking the Mobile App Installation in Phone memory of the Mobile Device
  33. Uninstallation of Mobile Apps needs to be tested to check whether the Mobile App related files are removed from the Mobile Device along with the App.
  34. And many more

Performance Testing

Performance Testing has to be performed at Device, Server/API and Network levels while using the Mobile Apps.

Things to verify as part of Mobile App Performance Testing:

  1. Checking whether the Mobile App is taking less time to launch (i.e. not more than 2 seconds after tapping the App icon from the Mobile Device Screen)
  2. Checking whether the Mobile App is not using more battery while using it constantly (i.e. Excess use of battery or other resources on the Mobile Device will result in Mobile Device Slow down and heating)
  3. Checking whether the Mobile App is not using more Memory while using (This will slowdown the Mobile Device if more memory is consumed by the Mobile App)
  4. Checking whether the Mobile App is performing well across the supported Mobile Device Models, OS Platforms and Versions.
  5. Checking whether the APIs behind the Mobile App are communicating with the App Server is a faster way for converting, sending and loading data
  6. Checking h0w many API calls are made by the Mobile App for getting the things done (i.e. The more API calls will degrade the Mobile App performance)
  7. Appropriate notifications to be displayed by the Mobile App to the user, when there is a network latency while using the App
  8. Checking how the Mobile App is performing on different networks like 2G, 3G, 4G, 4G LTE, WIFI etc.
  9. Checking how the Mobile App is performing in different circumstances (when you are in the lift, car parking cellar etc.)
  10. Checking how the Mobile App is performing when a load of users are using it simultaneously.
  11. Checking how the Mobile App is performing when the user is using it in a stressful way to its limits.

Security Testing

Security Testing is performed to check whether there are any security loop holes (i.e. Security Bugs / Vulnerabilities) in the Mobile App which allow the hackers to find them and use them for penetration / hacking purpose.

Security Testing on Mobile Apps testing is a vast subject and below are the basic things we check as part of Mobile App Security Testing:

  1. Whether the Mobile Application is asking you to create strong User Login Credentials
  2. Whether the Mobile Application is not storing the Login Credentials or any sensitive data as it is in its Database (Proper encryption should be followed while storing the sensitive data)
  3. Whether the Mobile Application is getting timeout after keeping the Mobile App idle by not using for a period of time

Apart from the above basic things, we can perform a detailed Security Testing on the Mobile Apps with an intention of finding any security loopholes (i.e. Vulnerabilities / Security Bugs).

For more information on how to perform extensive Security Testing on Mobile Apps, click here.

Interruption Testing

Interruption Testing can be performed on the Mobile Apps to check how the Mobile App in use will behave when it comes across different interruptions in the Mobile Device.

The below are the different interruptions that we face while using the Mobile App:

  1. Incoming Phone Call
  2. Incoming SMS
  3. Other App Notifications
  4. Other App update notifications
  5. Mobile Device OS Update Notifications
  6. Low Battery Mobile Device Notification
  7. Mobile Fully Charged Notification
  8. Incoming Video Call from other Apps (Say Whatsapp)
  9. Income App Chat Message Notifications (Say Whatsapp)
  10. Mobile Switched Off
  11. Mobile Alarm
  12. Mobile Reminders
  13. And other different interruptions

While these interruptions occur during Mobile App usage, the Users may decide to act or ignore based on the type and need of the notification.

For example, we got an important Phone call while using the Application, we accept the phone call and the mobile app should run in the background and restore once the User completes the call.

And in some other cases, the user may decline the call or ignore the call, and the App should continue working.

Hence we need to test how the Mobile Apps are behaving based on the User actions when these different types of interruptions occur.

Testing Mobile App in Online and Offline Modes

Some mobile applications are developed to work in both online and offline modes (i.e. with or without internet connection).

The reason for Mobile Apps to work in offline mode (i.e. Without internet) is the Users may travel to some locations where the internet won’t be available and the application has to work in offline mode for the User to use and input data into the Mobile App. Once the Mobile App gets to a location where the internet is available, the data entered by the User in offline mode has to sync.

Hence we need to test whether the Mobile Application is working properly in offline and online modes.

Web Services Testing

Sometimes the Web Services for the Mobile App need to be created in advance, before developing the Mobile App.

While developing the Mobile App, the developers use these Web Services and build the Mobile App on the top of these Web Services.

In such cases, we need to perform a detailed testing on the Web Services, their requests, their responses, positive and negative scenarios by varying the parameters, by providing valid inputs, by providing invalid inputs, by providing all parameters, by providing invalid parameters during request and so on.

Less testing will be required in the actual Mobile Application, when their web services are tested thoroughly before the actual Mobile App is developed.



Mobile Test Automation and Tools

Mobile App Testing can be performed in two ways:

  1. Manual Testing
  2. Automation Testing

In this section, I am going to explain about the Mobile Test Automation.

Mobile Test Automation

Business photo created by kjpargeter – www.freepik.com

Appium – Famous tool for Mobile Test Automation

Appium in simple terms is a Test Automation tool for testing the Mobile Applications and Mobile Browsers.

Out of all the Automation Tools available in the market for performing the Mobile Test Automation, Appium is the most famous tool.

The following are the different points which makes Appium the famous Mobile Test Automation Tool:

  1. Appium is an Open Source and Free Test Automation Tool
  2. While other Mobile Test Automation Tools can automate only Android Apps or iOS Apps, Appium Test Automation is a Cross Platform Test Automation Tool which can automate both Android, iOS and Windows Apps.
  3. Appium supports good number of programming languages like Java, C#, Python, Ruby, JavaScript and PHP for developing the Test Automation code.
  4. Appium supports performing Automation Testing on Real Devices, Emulators and Simulators

Apart form Appium, we also have other Mobile Testing Automation Tools.

The following are the different Mobile Test Automation Tools in the market:

  1. Appium
  2. Test Project
  3. Froglogic Squish
  4. Robotium
  5. Test Complete
  6. Ranorex
  7. MonkeyRunner
  8. UI Automator
  9. Selendroid
  10. MonkeyTalk
  11. Katalon Studio
  12. Testdroid
  13. Calabash
  14. Frank
  15. SeeTest
  16. KIF
  17. IOS UI
  18. IOS-Driver
  19. UFT Mobile
  20. Telerik Test Studio
  21. eggPlant


Google Chrome Dev Tools for Mobile Testing

If the Web Applications are Mobile enabled, then we can test whether we can browse our Web Application in the Mobile Devices.

Google Chrome Dev Tools can be used for testing the Mobile Enabled Web (MEW) Applications in the different simulated Mobile Devices.

Google Chrome Browser Dev Tools

The below are the steps for opening the Web Application in the simulated Mobile Devices provided by Google Chrome Dev Tools:

  1. Open the Website to be tested for Mobile View in the Google Chrome Brower
  2. Press F12 key on your keyboard in Windows machine and observe that the Chrome Dev Tools will open
  3. If the Chrome Dev Tools are by default displayed at the bottom of the page, then  you can move them to right side by selecting ‘Three Dots’ on the Chrome Dev Tools and then selecting ‘Dock to Right’ option
  4. Now, select the Mobile Device symbol to view the Web Page in Mobile View
  5. By default some Mobile Device Simulation will be selected, and you can choose the specific device you need from the Mobile Devices dropdown
  6. Now Test the Website in Mobile Web mode in your desired device.

Apart from the above simulation of Mobile Devices using Google Chrome Dev Tools, we can also simulate the Network (i.e. internet speed), GPS Location and Device Orientation using the Goolge Chrome Dev Tools options.

Click here to explore more about how to use the Google Chrome DevTools for simulating Mobile Devices, Network, GPS Location and Device Orientation.



Form Factor

Form Factor is one of the terminologies used in Mobile App Testing.

So, what exactly is Form Factor?

Form Factor in simple terms is the general look (i.e. style) of the Mobile Device.

Form Factor of Mobile Device comprises of the below things which result in actual look or style of the Mobile Device:

  1. Size of the Device
  2. Shape of the Device
  3. Look/Style of the Device
  4. Layout of the device
  5. Position of the different major components on the device

How Form Factor is related to Mobile App Testing?

We may have to check whether our Mobile Apps under test are working with different mobile devices having different form factors.



Screen-fly Tool for Mobile Testing

If the Web Applications are Mobile enabled, then we can test whether we can brows our Web Applications in the different supported Mobile Devices.

Screenfly can be used for testing the Mobile Enabled Web (MEW) Applications in the different simulated Mobile Devices.

Screenfly

Follow the below steps for browsing the Mobile Enabled Web Application on the different simulated Mobile Devices in the Screenfly:

  1. Open Screenfly.org in any browser say Chrome
  2. Enter the Web Application URL that you want to browse in the different Mobile Devices and click on ‘Go’ button
  3. Now select ‘Mobile’ option and select any of the displayed Mobile Device say ‘Apple iPhone 6/7’
  4. Observe that the given Web Application URL will be displayed in the ‘Apple iPhone 6/7’ simulator
  5. Also, select ‘Tablet’ option and select any of the displayed Mobile Device say ‘Apple iPad’
  6. Observe that the given Web Application URL will be displayed in the ‘Apple iPad’ simulator.

After browsing the Web Application URL in the Mobile and Tablet simulators provided in the Screenfly, we can also perform the below operations:

  1. Customize the Screen size of the selected Mobile Device Simulator
  2. Refresh the Web Page which is loaded in the selected Mobile Device Simulator
  3. Rotate the Web Page loaded in the selected Mobile Device Simulator
  4. Add the vertical scroll bar to the simulated mobile device for scrolling


Taking Screenshots of different Mobile Devices

While testing the Mobile Apps in different mobile devices, we may come across different bugs.

These bugs has to be reported in our defect tracking tool along with proofs.

These proofs can be the screenshots of the Mobile App Screen where the bug has been found.

In-order to take screenshots of the Mobile App screen in our Mobile Devices, we need to find-out the way of taking screenshots in different mobile devices.

Taking Screenshots in Android Device

In any Android Device, we need to simultaneously press the ‘Volume Down’ button and ‘Power’ button of the Device at the same time to capture the screenshot of the current shown mobile screen.

Android Device Taking Screenshots

Taking Screenshots in iOS Mobile Device

In any iOS Mobile Devices, we need to simultaneously press the ‘Home’ button and the ‘Power’ button of the Device at the same time to capture the screenshots of the current shown mobile screen.

IOS Device Taking Screenshots



GenyMotion Tool for Mobile Testing

GenyMotion is an Android Emulator.

We can test our Mobile Apps in the different ready made virtual mobile devices provided by the GenyMotion.

GenyMotion

The below are the different steps for using the virtual mobile devices provided by the GenyMotion Emulator solution:

  1. Download and install the GenyMotion software in your machine
  2. Launch the GenyMotion
  3. Install any virtual mobile device in GenyMotion from the displayed mobile device list options
  4. Run the installed virtual mobile device from GenyMotion
  5. Use the various GenyMotion options provided for the virtual mobile device that is running

Click here to explore more about the GenyMotion and the options provided by it for Mobile App Testing (Which includes a sample android mobile app installation and testing in the virtual mobile device which is launched in the Genymotion tool)



Mobile App Extensions of major Mobile OS Platforms

If you are using Windows Laptop, and you want to install any Software, then we have to install the Software Program having .exe as extension.

Similarly, different Mobile OS Platforms have different Mobile App extensions.

The below are the major Mobile OS Platforms and their Mobile App extensions

  1. Android OS – Mobile Apps having .apk (Android Package Kit) as extensions are required for installing
  2. iOS OS – Mobile Apps having .ipa (iOS App Store Package) as extensions are required for installing
  3. Windows Mobile OS – Mobile Apps having .XAP  (or newer APPX) as extension are required for installing


Kobiton Paid Tool for Mobile Testing on Real Mobile Devices

Kobiton is a paid tool for performing Mobile Testing on Real Mobile Devices.

Kobiton

The following are the different points for understanding how Kobiton Paid Tool is different from other Mobile Testing Tools in the market:

  1. Instead of testing on Emulators/Simulators, Kobiton hosts several Real Physical Mobile Devices on the Cloud (i.e. Internet)
  2. We can perform Manual and Automation Testing on these Real Devices which are hosted on the cloud
  3. We can create an Account with Kobiton and access their Real Cloud Hosted Mobile Devices from our browsers itself.
  4. And Kobit0n is providing several options like Mobile Gestures, Log Extraction etc. for better testing.

Steps for trying Kobiton Tool’s Free Trial:

  1. Click on Free Trial option available here – https://kobiton.com/real-device-testing/
  2. Create an Account
  3. Verify the Account using the email sent
  4. Login to the account and try out the real mobile devices which are hosted on the cloud using the Kobiton provided interface


Other Tools for Mobile Testing

Apart from the above explained Tools which support Mobile Testing, there are several other tools.

Mobile Cloud Testing Tools

  1. Testdroid
  2. Experitest
  3. TestingBot
  4. headSpin
  5. Test IO
  6. UI Automator
  7. IPhoney
  8. TestFairy
  9. SauceLabs
  10. BrowserStack
  11. Reflector
  12. Perfecto Mobile
  13. Remote TestKit
  14. pCloudy
  15. AWS Device Farm

Mobile Performance Testing Tools

  1. dynatrace
  2. NeoLoad
  3. Blazemeter

Mobile Security Testing Tools

  1. OWASP ZAP
  2. BurpSuite
  3. Mobile Security Framework (MobSF)
  4. ImmuniWeb Mobile Suite
  5. Micro Focus
  6. And many more


Mobile Network Technologies

Apart from understanding the different Mobile Devices, Mobile OS Platforms, we also need to have knowledge about the Mobile Network Technologies that our Mobile Devices use for day to day communication.

The below are the common Mobile Network Technologies available in the market:

  1. GSM
  2. CDMA
  3. UMTS
  4. LTE
  5. And many more

Here ends this article.

Hope you enjoyed it.

Kindly provide your valuable feedback which will motivate us to write more this kind of articles.

Please leave your questions/comments/feedback below.

Happy Learning 🙂

About Me > Arun Motoori

On a mission to contribute to the Software Testing Community in all possible ways.

Comments (4)

Leave a Reply

Your email address will not be published. Required fields are marked *