Sauce Labs: Boon for Cross Browser Testing

The global automation testing market size is anticipated to reach USD 68 billion by 2025. Integration of the Internet of Things (IoT), DevOps, and Artificial Intelligence (AI) into the software development process, led to automation solutions in their operations driving the demand for the automation testing market. Sauce Labs is one of the solutions to that increasing demand as shown in Figure 1 [1].Salesforce.com, Mozilla, Zendesk, Puppet Labs, Twitter, Bank of America, Eventbrite, Bleacher Report, Okta, Intuit, Travelocity, Sharecare, CapitalOne are all its customers.

sauce labs, manual testing, QA

Features

Sauce Labs provides the world’s largest cloud-based platform for the automated testing of web and mobile applications. Its service eliminates the time and expense of maintaining an in-house testing infrastructure, relaxing development teams from the overhead of releasing software builds faster by providing these products[2]:

  • API Fortress, provider of API testing solutions for agile and DevOps teams
  • AutonomIQ is, a provider of scriptless test automation solutions to help users quickly and easily create and execute tests for modern SaaS and low-code applications
  • TestFairy, provider of an enterprise-grade, all-in-one test platform for mobile beta testing
  • Sauce Labs’ dashboards contain multiple useful metrics in one place.
  • Sauce Labs is optimized for automation and integration with the major CI/CD platforms and developer tools. It can be integrated with App Center and have a storage API that helps to retrieve APK and IPA, iOS and Android build off the phone, so that continue testing with CI/CD(Jenkins) can be continued.

ISO 27001 and SOC 2 Type 2 certifications apply to all Sauce Labs products – including the recent acquisitions of Backtrace, AutonomIQ, Test Fairy, and API Fortress in 2021.  It shows the commitment to accelerating the release of high-quality software for its customers by giving priority to protecting customer data.

Popularity

As noted in the Forrester report, “the infusion of Machine Learning (ML) in Sauce Labs’ strategy shows the new failure analysis capability that uses ML to work with pass/fail data and Selenium command logs to uncover and aggregate common failures, providing insights into how they affect test suites as a whole.” It helps developers, testers, and QA managers to analyze how often the same type of failure repeats itself across a given test suite, enabling them to move quickly to address the most pervasive issues and drive rapid improvement in test quality. Sauce Labs’ popularity can be judged from the report that nearly 3 million tests are now run each day across its continuous testing cloud platform, which spans thousands of browser/OS, mobile emulator, simulator, and real device combinations.

There are competitors of Sauce Lab like LambdaTest, AWS Device Farm, Selenium, and TestComplete. There are a few factors that help the client to choose the best tool that allows testing mobile applications and websites across numerous browsers, physical devices, and OS. The factors include Ease to set up and use, License Cost, Quality of Customer support, Cost involved in training employees on the tool, Hardware/Software requirements of the testing tool, Reviews of the company, Plugins and API support, Support policy of the tool vendor and Support for multiple platforms.

Analysis (Sauce Lab)

If there are three manual testers in a start-up like AgBe. One tester is handling web application, the second one test android builds and the third one tests iOS testing. All three need separate resources for their testing jobs. It costs heavily for all resources and with addon expenses for different software purchases and licenses that are required to run the tests. This cost is for manual testing only. On the other hand, Space Lab offers customized pricing plans for startups as mentioned in Table 1 which makes cloud-based real device testing makes much more achievable than in the past. It’s possible to have a set of smoke tests run on even one real device on every build through space labs.

Table 1: Basic Pricing Plans Detail for Start-ups [3]

Testing EnvironmentDescriptionPrice per one parallel test  
Live TestingManual cross-browser & mobile app testing on 1000s of desktop browsers, real mobile devices, emulators & simulators$39 /Month
Virtual CloudAutomated + Manual cross-browser & mobile app testing on 1000s of desktop browser/OS combos, mobile emulators & simulators$149 /Month
Real Device CloudAutomated + Manual mobile cross-browser & app testing of 1000s of real mobile devices$199 /Month
Price is for unlimited users and unlimited testing minutes

No matter how much the company’s size, industry, or expertise level is, training and support are available for sauce lab easily.

  1. EMA_Report_-_The_ROI_of_Sauce_Labs_-_January_2020
  2. https://saucelabs.com/news/sauce-labs-recognized-for-setting-an-ambitious-vision-in-report-by-independent-research-firm-ties-for-top-score-in-strategy-category
  3. https://saucelabs.com/pricing
  4. https://www.guru99.com/sauce-labs-competitors.html

More
articles