CI to check configured severity for Sev 1 tests #1044
Description
Is your feature request related to a problem? Please describe.
We want all severity 1 issues to error rather than warn. #1043 is an example of a case where we are warning rather than erroring
Describe the solution you'd like
some sort of CI that checks sev levels for tests flagged severity 1 and makes sure that they're set to error rather than warn
Describe alternatives you've considered
could wait on this
Additional context
Add any other context or screenshots about the feature request here.