Why might my tests be being 'Skipped'?

[mooragor]

Hi all. We are in the process of migrating from Specflow to Reqnroll. When I run things locally, from command line or using Rider IDE, everything seems fine and all tests run.

When we run in our build CI pipeline, a number of tests are being 'skipped'. We are trying to work out why this is happening (may not be Reqnroll, but it's all started happening at the same time which is suspicious)

Is there any way we can get dotnet test to tell us why tests were 'skipped'?

Additionally - why would the 'Skipped' tests not be being counted under the number of Skipped tests listed at the end of the run (are there different skipping mechanisms?) - "Skipped: 0"

Each of the feature files has an '@regression' tag at the top of the feature file which maps to the "TestCategory=regression" (NUnit).
The few feature files that don't have @regression in them are correctly being ignored entirely for the run.

The command like that kicks off the test run in the build pipeline is:
"C:\Program Files\dotnet\dotnet.exe" test C:\agents\agent-a\_work\5504\s\Tests\Web.UI.Tests\Web.UI.Tests.csproj --logger trx --results-directory C:\agents\agent-a\_work\_temp --configuration Release --filter TestCategory=regression

Example output with some of the skipped tests removed for brevity - a total of 16 tests were listed as 'Skipped', but then the Skipped count at the end is 0.

Web.UI.Tests -> C:\agents\agent-a\_work\5504\s\Tests\Web.UI.Tests\bin\Release\net8.0\Web.UI.Tests.dll
Test run for C:\agents\agent-a\_work\5504\s\Tests\Web.UI.Tests\bin\Release\net8.0\Web.UI.Tests.dll (.NETCoreApp,Version=v8.0)
VSTest version 17.12.0 (x64)

Starting test execution, please wait...
A total of 1 test files matched the specified pattern.
  Skipped TestXXX [6 s]
  Skipped TestXXY [8 s]
  Skipped TestXXZ [5 s]
  ...

Results File: C:\agents\agent-a\_work\_temp\TfsReleaseAgent_XXXXXXX_2025-03-10_15_33_41.trx

Passed!  - Failed:     0, Passed:    10, Skipped:     0, Total:    10, Duration: 2 m 44 s - Web.UI.Tests.dll (net8.0)

[mooragor]

Have worked it out. It's old step definitions that were regexes not being found. I'd not added the ^ & to the start and end of the string that is required.
Now to try and work out where the nice error messages went and why they didn't show up in the summary! Possibly that logging option.

[gasparnagy]

The MsTest plugin had a bug and it logged all messages to the console as well (#368), probably this is why you have seen the "nice" error messages before. I think if you run the tests with the console logger enabled (dotnet test --logger "console;verbosity=detailed") you will see those (see https://learn.microsoft.com/en-us/dotnet/core/tools/dotnet-test?tabs=dotnet-test-with-vstest#examples)