Running automated tests locally with Sencha Test 2.1 on 19 devices simultaneously

Posted 7 years ago by Jiri Znoj

As part of my daily activities during automated test development for our Ext JS 6.5 web applications, I usually need to verify that newly developed test can be run on various platforms. Those platforms are various web browsers running on all sort of devices such as desktop, tablets or smartphones.

To manage automated test execution I have been using Sencha Test from Sencha for last couple of months. I rely on Sencha Test ability to execute tests on multiple platforms in parallel as well as it’s ability to give me overview of all executed tests and it’s results for all platforms on one page.

So I have decided today, that I’ll give it a try and run my tests on as many devices as I saw in our office and run them all at once. I’ve successfully run my tests on 19 devices (combination of laptops, tablets, smartphones) with 25 web browsers and I was impressed that it went pretty smoothly.

To demonstrate it, I’ve recorded following video:

Definitely have a look as it talks for itself.

Results

Please see below couple of screenshots to demonstrate the results from my test run. You can find list of devices I have used during the test on the bottom of the blog.

Image 1
Image 1

In image 1 you can see Sencha Test and test results of all executed tests on all platforms on one page. There are 2 disabled test cases due to known bug in Internet Explorer 11, something I have pointed out during video.

Image 2
Image 2

Digging little deeper, in image 2 you can see an error. That error is in browser Safari 7.1, which is not supported by ExtJS 6.5 framework – modern toolkit. You can read from error log, that clientWidth of some element in dom is not higher than 0 (px). I am using this condition for one of detections, that example was correctly loaded.

Image 3
Image 3

Image 3, the highlighted tick mark, represents tests that passed. On the right-bottom panel you can see values which are tested for detecting possible errors in ExtJS framework.

In the middle you can see structure of the tests and their results, on the left side devices and its browsers. Summary rows gives you an information about overall test results.

I am not going to more details about ExtJS framework or Sencha Test. If you are interested about that, these are good places to start:

https://www.sencha.com/products/extjs/
https://www.sencha.com/products/test/

And finally here is the list of devices which I used in my test and demonstration in video:

Device Type Browser(s)
Windows 10 desktop Chrome 59, Firefox 53, Internet Explorer 11, Opera 45, Edge 15
Android 4.4.2 tablet Chrome 52
Android 7.1.1 tablet Chrome 58
Android 5.1.1 phone Chrome 51
Android 5.0.2 tablet Chrome 55
iOS 10.3.2 phone Safari 10
Windows 10 desktop Edge 14
Android 6.0.1 tablet Chrome 58
iOS 9.3.4 phone Safari 9
Android 5.0.2 phone Chrome 58
Windows Phone 10 phone Edge 15
Android 6.0.1 phone Chrome 58
iOS 10.3.2 tablet Safari 10
Android 7.0 phone Chrome 51
Windows 8.1 desktop Chrome 59, Internet Explorer 11
Android 4.4.2 phone Chrome 58
Mac OS X 10.9.5 desktop Chrome 58, Safari 7.1
Mac OS X 10.10.5 desktop Chrome 58, Safari 10.1

As a conclusion, I was happy to see that Sencha Test 2.1 is capable of running all my tests at once on as many platforms as I need. As I need to verify, whether my newly developed tests are supporting most of the modern browsers, having Sencha Test helps me with such testing and saves me tremendous time. If you have similar needs, such as you are developing web applications or automated tests to verify those applications, and want to assure they run properly on various platforms, I highly suggest to look at Sencha Test.

Should you have any feedback or questions, feel free to comment.

Jiri Znoj

Leave a Reply

Related articles