Add isHealthy Parameter to the Environment Object #38
Closed
alexshamrai
started this conversation in
Schema
Replies: 1 comment 1 reply
-
|
This will be a great addition! I’ll use Since we’re still pre-v1, I’ll be adding the Thanks for the great idea @alexshamrai! |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Extend the CTRF test report schema by adding a new optional
booleanfieldisHealthyto the environment object within the results section.This flag will represent whether the test execution environment was detected as healthy or flaky at the time of test execution.
Motivation
The testing solution can sometimes detect environmental instability automatically — for example, unexpected Kubernetes pod restarts, degraded service availability, or transient infrastructure issues.
Including a isHealthy flag in the CTRF report allows the test framework to record such flakiness signals directly within the report metadata.
It will help to distinguish test failures caused by environment issues from real product issues, and also track and analyze environmental flakiness trends over time.
Also, it will allow to support automatic filtering or alert suppression when the environment is unstable.
@Ma11hewThomas Thanks in advance!
Beta Was this translation helpful? Give feedback.
All reactions