Can Mobile Application Testing be carried out through Crowd-sourcing? When there are loads of emulator and remote devices, what are the benefits that Crowd Testing offers to Mobile Application Developers though Crowd Testing.
App Developers have the need to quickly test their application on the number of OS versions of their platforms. With the proliferation of Android, iOS and Windows Mobile Operating Systems, the test matrix of these applications has exploded. One of the best practices in the industry is to use emulators to verify the major functionality of the application. The functionality that can be verified through software is done through emulators, i.e. these set of mobile use cases are independent of the underlying platforms and phone models. The next level of testing is got through testing with remote devices. This gives the ability to test the mobile application on real phones, but accessed remotely. Remote devices enable mobile app developers to test their mobile app on a real phone, through which they can verify features that are dependent on the underlying operating system version and mobile phone model. But even testing on remote devices does not give the ability to test network dependent features and also does not allow for remote automation to execute on these phones. The third and last step of testing mobile app would be test on physical phones with the network carrier, to explore and find bugs related to the network and the application.
So the recommended set for testing mobile applications is
- Test Major Functionality on Emulators.
- Phone Dependent Functionality is Tested on Remote Devices.
- Physical Phone or Network dependent features are tested on the device.
Now, Coming to the benefits of getting your mobile application tested by the Crowd on their own handsets are that the developer can by pass the above three steps to get feedback from a diverse set of testers on their own devices. This allows for feedback about the application in a manner, which gives the developer insights into where the application code is brittle and also which part of the functionality is affecting the critical user flows in his application. i.e. Getting instant feedback on critical functionality of the application in short time, helps to catch important issues/bugs during the development cycle rater than waiting for the app to go through emulators, remote devices and then real devices.
99tests has got great results in testing iphone applications and also GPRS applications from our community of testers. We are also testing Android applications on large number of devices.