<img height="1" width="1" style="display:none" src="https://www.facebook.com/tr?id=1125905954966175&amp;ev=PageView&amp;noscript=1">
3 min read

Nisum Increased Test Run Frequency by 400% per Day by Implementing an In-house Test Lab

Oct 28, 2022 4:51:50 PM

Nisum implemented an in-house test lab with the required browser combinations to increase test run frequency and reduce costs.

mobile-browser-in-house-test-lab

The client’s new in-house test lab was implemented with the required browser combinations and desired browser versions, leading to:

+$24k
saved per year in licensing fees

 

-66%
decrease in failed test root-cause analysis time

Increased test pass-rate

Business Challenge

A Fortune 500 retailer used third-party test labs for their eCommerce website’s mobile cross-browser testing, leading to: 

  • An insufficient number of mobile browser combinations needed for testing because the test lab provider was not agile enough
  • High licensing costs for a limited supply of real devices

New call-to-action

 

Solution

Nisum helped the client set up an in-house test lab with the required iOS browser combinations using spare commodity Mac machines (readily available devices). We also automated the process of upgrading all Android emulators in the in-house test lab with the desired browser versions, resulting in:

  • Cost savings for at least 10 additional concurrent sessions on a real device cloud (a mobile testing environment) with the new in-house test lab
  • Increased test run frequency from 1 to 4 times per day, resulting in:
    • Increased test pass-rate by modifying the cross-browser test automation framework to only execute failed tests on all combinations multiple times a day after running a full set of tests
    • Decreased failed test root-cause analysis time with side-by-side reporting, which resulted in the insight that tests that failed consistently were most likely cross-browser issues


Feel free to contact us for more information on how Nisum can drive results for your company.

Nisum

Nisum

Founded in California in 2000, Nisum is a digital commerce company focused on strategic IT initiatives using integrated solutions that deliver real and measurable growth.

Have feedback? Leave a comment!

Featured

Blog by Topics

See All
3 minutos de lectura

Nisum Increased Test Run Frequency by 400% per Day by Implementing an In-house Test Lab

Oct 28, 2022 4:51:50 PM

Nisum implemented an in-house test lab with the required browser combinations to increase test run frequency and reduce costs.

mobile-browser-in-house-test-lab

The client’s new in-house test lab was implemented with the required browser combinations and desired browser versions, leading to:

+$24k
saved per year in licensing fees

 

-66%
decrease in failed test root-cause analysis time

Increased test pass-rate

Business Challenge

A Fortune 500 retailer used third-party test labs for their eCommerce website’s mobile cross-browser testing, leading to: 

  • An insufficient number of mobile browser combinations needed for testing because the test lab provider was not agile enough
  • High licensing costs for a limited supply of real devices

New call-to-action

 

Solution

Nisum helped the client set up an in-house test lab with the required iOS browser combinations using spare commodity Mac machines (readily available devices). We also automated the process of upgrading all Android emulators in the in-house test lab with the desired browser versions, resulting in:

  • Cost savings for at least 10 additional concurrent sessions on a real device cloud (a mobile testing environment) with the new in-house test lab
  • Increased test run frequency from 1 to 4 times per day, resulting in:
    • Increased test pass-rate by modifying the cross-browser test automation framework to only execute failed tests on all combinations multiple times a day after running a full set of tests
    • Decreased failed test root-cause analysis time with side-by-side reporting, which resulted in the insight that tests that failed consistently were most likely cross-browser issues


Feel free to contact us for more information on how Nisum can drive results for your company.

Nisum

Nisum

Founded in California in 2000, Nisum is a digital commerce company focused on strategic IT initiatives using integrated solutions that deliver real and measurable growth.

¿Tienes algún comentario sobre este? Déjanoslo saber!

Destacados

Blogs por tema

See All