Combine Cypress results for multiple environments as single run in Dashboard

0
votes

Regarding the Cypress Dashboard and runs

We are running smoke and end-to-end tests post-deployment and the tests are run against multiple environments Is it somehow possible to combine the results for all the environments into a single run in the Dashboard?

Current results as an example:

We run the smoke tests against 8 environments that have different configurations

  • 7 of these environments are ok and are marked as a success
  • 1 environment fails

If the run for the failed environment isn't the latest to be run the test in the Dashboard is green and we sometimes don't notice that something failed through the Dashboard

Technically they are all being run from the same commit id

Is there any command-line parameter that will combine this so that the Dashboard will look at this as the same run but just against different environments similar to how it does with browsers?

I've been going through the documentation and issues on GitHub but cant find anything related to this

1
cypress

1 Answers

0
votes

Yes, you can construct a unique id and use the --ci-build-id passed to cypress run https://docs.cypress.io/guides/guides/command-line.html#cypress-run-ci-build-id-lt-id-gt

There is an example in the Cypress Real World App, a payment application to demonstrate real-world usage of Cypress testing methods, patterns, and workflows, in the Circle CI configuration. Note, this uses the Circle CI Orb syntax which maps to the --ci-build-id command line parameter.