How to set time out on Firebase Test Lab?

0
votes

I'm running Espresso Android tests on Firebase (Test Lab) and it always display the error:

The test has expired. It has been run longer than the maximum allowed duration and has been interrupted. (Test timed out).

If I increase the timeout to 1h (for example), when I run the tests is displayed the next error:

(gcloud.firebase.test.android.run) Http error while creating test matrix: ResponseError 400: Given test timeout of 60 min exceeds limit of 30 min.

So, my questions are:

  • Is there any option to choose testing on Firebase on Virtual devices to increase test duration?
  • Is there any workaround to work with Firebase Test Lab?
  • Should I add some instrumentation on my Espresso Android tests?

Any help is appreciated.

Note: I have the Firebase plan Free

  • Virtual Device Tests: 10 tests/day
  • Physical Device Tests: 5 tests/day

Thanks, xptoGirl

1
firebasecontinuous-integrationandroid-espressofirebase-test-lab
what happens when you set the timeout to 30 minutes (the stated limit)? - Richard II

1 Answers

0
votes

The max test timeout is dependent on the device form you use:

  • Physical: 30 min
  • Virtual: 60 min
  • Physical and virtual in one test: 30 min

In your case you probably use a physical device, thus cannot increase the timeout to 60 min as 30 min is the limit. You can try virtual to get 60 min of test time.

You should probably also take a look at why your tests are running that long. Do you actually have that many tests that you need to run for an hour? Or is there something you can do to improve individual test durations?