Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

Multi-Browser and Multi-Environment Testing in Serenity BDD

DZone's Guide to

Multi-Browser and Multi-Environment Testing in Serenity BDD

If you've designed a web application, but need to make sure it works on several browsers, or runs in several environments, try Serenity BDD.

· Web Dev Zone ·
Free Resource

Deploying code to production can be filled with uncertainty. Reduce the risks, and deploy earlier and more often. Download this free guide to learn more. Brought to you in partnership with Rollbar.

When we write automated acceptance tests, we often want to run the same test in different environments, or on different browsers, and still see each test run appear in the reports.

The latest version of Serenity BDD allows you to implement multi-browser and multi-environment testing using the notion of contexts. A context is a way of running the same test several times, and showing all of the results in the same report.

Simple Test Contexts

For example, you could run your tests using the Chrome WebDriver, providing a context called “chrome”:

$ mvn verify -Dcontext=chrome -Dwebdriver.driver=chrome

You might then run the tests again (or in parallel, on a different machine) using Firefox:

$ mvn verify -Dcontext=firefox -Dwebdriver.driver=firefox

You might also run the tests a third time using PhantomJS:

$ mvn verify -Dcontext=phantomjs -Dwebdriver.driver=phantomjs

Serenity will now include test runs for all three browsers in the same report:

Adding More Readable Tags

Serenity will add a “context” tag to each of your tests, but you might want to make your reports even clearer by adding a more meaningful tag. You can do this using the “injected.tags” system property:

$ mvn verify -Dcontext=chrome -Dwebdriver.driver=chrome -Dinjected.tags="browser:chrome"   

This way, you would get tags for both the browsers and the test contexts appearing in the reports:

Serenity BDD supports multi-browser and multi-environment testing.

Serenity BDD supports multi-browser and multi-environment testing.

(You can disable the context tag entirely if you prefer by setting the serenity.add.context.tag property to false).

Cross-Browser and Cross-OS Tests

There are a couple of common use-cases for contexts: running the same test in different browsers and running the same test on different operating systems. If you use the name of a browser (e.g. “chrome”, “firefox”, “safari”, “ie”), the context will be represented in the reports as the icon of the respective browsers. If you provide an operating system (e.g. “linux”, “windows”, “mac”, “android”, “iphone”), a similar icon will be used. If you use any other term for your context, it will appear in text form in the test results lists, so it is better to keep context names relatively short.

Aggregating Test Results

You may also choose to run a large test suite on several machines in parallel, and then merge the reports together. You can do this simply by:

  1. Providing a different context for each test run.
  2. Copying the contents of the target/site/serenity directories into the target/site/serenity directory of your main project.
  3. Generate the aggregate reports from this main project (using “mvn serenity:aggregate” or “gradle aggregate”).

These features will work with version 1.4.0 of serenity-core.

Deploying code to production can be filled with uncertainty. Reduce the risks, and deploy earlier and more often. Download this free guide to learn more. Brought to you in partnership with Rollbar.

Topics:
bdd ,web dev ,web application ,testing

Published at DZone with permission of

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}