Does device-farm capture passing tests?

[alexander-lazaris-sonder]

Hi all, I'm wondering why on the Stats tab, I only see my test failures. I've had passing tests but for some reason they don't appear.

Is there an additional setting I need to add this? Is this feature supported? Am I missing something?

Cheers!

[sudharsan-selvaraj]

@alexander-lazaris-sonder By default, the device farm marks tests as failed whenever an Appium command fails (e.g., calling findElement within a wait block). However, users have the flexibility to update the test status based on the actual execution results.

Webdriver IO:

driver.executeScript("devicefarm: setSessionStatus", {"status": "passed/failed", "reasonn": "optional reason"})

[alexander-lazaris-sonder]

Hmm, that's fine though it's not quite the answer I was seeking.

Are you saying @sudharsan-selvaraj that I need to add that driver command above into an event hook somewhere? I was hoping that the device-farm picks up test passes/failures automatically.

Based on my usage so far (limited), it seems to only pick up test failures. Within the 'Builds' and 'Stats' pages of the dashboard, I am only seeing test failures (be it appium or assertion failures).

[saikrishna321]

@alexander-lazaris-sonder I was hoping that the device-farm picks up test passes/failures automatically. No, coz this is on server side, user has to tell plugin if the test has passed or failed.

[maczet]

This will be nice feature automatic update test result based on eg. xml file