Test Explorer when converting from Specflow+SpecRun to Reqnroll+MsTest using Gherkin

[terrimitchell]

in Specflow, Test Explorer matched the feature file Scenario text exactly.

But in Reqnroll, the Scenarios are converting all dashes and periods to underscores, as well as changing it to camel/Pascal case and removing all spaces. As a result, we can no longer double-click on a test or even choose the "Go to test" option when right-clicking. It is also much harder to read the test names now.

Is there some plugin we need to add or something to get Test Explorer to work like it did before and 1) NOT change the test name at all and 2) allow navigation to the feature file?

We were and still are using MSTest.TestAdapter and MSTest.TestFramework, though we were using an older version in Specflow (3.0.2) vs Reqnroll (3.8.3).

[304NotModified]

Could you please post the generated test code with SpecFlow 3 and with Reqnroll 2?

[terrimitchell]

I'm not sure I understand your question..... This is simply looking in the Test Explorer to get to the test.....the test has not been run yet. If you mean the cs file that was created for the feature file, that I can do. do you need the entire file or is just this snippet enough?

Specflow:

// ------------------------------------------------------------------------------
//  <auto-generated>
//      This code was generated by SpecFlow (https://www.specflow.org/).
//      SpecFlow Version:3.9.0.0
//      SpecFlow Generator Version:3.9.0.0
// 
//      Changes to this file may cause incorrect behavior and will be lost if
//      the code is regenerated.
//  </auto-generated>
// ------------------------------------------------------------------------------
#region Designer generated code
#pragma warning disable
namespace Automation_Elluminate.Features
{
    using TechTalk.SpecFlow;
    using System;
    using System.Linq;
    
    
    [System.CodeDom.Compiler.GeneratedCodeAttribute("TechTalk.SpecFlow", "3.9.0.0")]
    [System.Runtime.CompilerServices.CompilerGeneratedAttribute()]
    [TechTalk.SpecRun.FeatureAttribute("AdministrationUrlSettings", new string[] {
            "Administration",
            "UrlSettings"}, SourceFile="Features\\AdministrationUrlSettings.feature", SourceLine=1)]
    public partial class AdministrationUrlSettingsFeature
    {
        
        private TechTalk.SpecFlow.ITestRunner testRunner;
        
        private string[] _featureTags = new string[] {
                "Administration",
                "UrlSettings"};
        
#line 1 "AdministrationUrlSettings.feature"
#line hidden
        
        [TechTalk.SpecRun.FeatureInitialize()]
        public virtual void FeatureSetup()
        {
            testRunner = TechTalk.SpecFlow.TestRunnerManager.GetTestRunner();
            TechTalk.SpecFlow.FeatureInfo featureInfo = new TechTalk.SpecFlow.FeatureInfo(new System.Globalization.CultureInfo("en-US"), "Features", "AdministrationUrlSettings", null, ProgrammingLanguage.CSharp, new string[] {
                        "Administration",
                        "UrlSettings"});
            testRunner.OnFeatureStart(featureInfo);
        }
        
        [TechTalk.SpecRun.FeatureCleanup()]
        public virtual void FeatureTearDown()
        {
            testRunner.OnFeatureEnd();
            testRunner = null;
        }
        
        public virtual void TestInitialize()
        {
        }
        
        [TechTalk.SpecRun.ScenarioCleanup()]
        public virtual void TestTearDown()
        {
            testRunner.OnScenarioEnd();
        }
        
        public virtual void ScenarioInitialize(TechTalk.SpecFlow.ScenarioInfo scenarioInfo)
        {
            testRunner.OnScenarioInitialize(scenarioInfo);
        }
        
        public virtual void ScenarioStart()
        {
            testRunner.OnScenarioStart();
        }
        
        public virtual void ScenarioCleanup()
        {
            testRunner.CollectScenarioErrors();
        }
        
        public virtual void FeatureBackground()
        {
#line 4
#line hidden
#line 5
    testRunner.Given("We are at the Sign In page", ((string)(null)), ((TechTalk.SpecFlow.Table)(null)), "Given ");
#line hidden
        }
        
        [TechTalk.SpecRun.ScenarioAttribute("EL-11302.01 Verify URL Settings for Allow In Progress on Issues", new string[] {
                "Settings",
                "PassesOnSecondRun"}, SourceLine=7)]
        public virtual void EL_11302_01VerifyURLSettingsForAllowInProgressOnIssues()
        {
            string[] tagsOfScenario = new string[] {
                    "Settings",
                    "PassesOnSecondRun"};
            System.Collections.Specialized.OrderedDictionary argumentsOfScenario = new System.Collections.Specialized.OrderedDictionary();
            TechTalk.SpecFlow.ScenarioInfo scenarioInfo = new TechTalk.SpecFlow.ScenarioInfo("EL-11302.01 Verify URL Settings for Allow In Progress on Issues", null, tagsOfScenario, argumentsOfScenario, this._featureTags);
#line 8
this.ScenarioInitialize(scenarioInfo);

Reqnroll:

// ------------------------------------------------------------------------------
//  <auto-generated>
//      This code was generated by Reqnroll (https://www.reqnroll.net/).
//      Reqnroll Version:2.0.0.0
//      Reqnroll Generator Version:2.0.0.0
// 
//      Changes to this file may cause incorrect behavior and will be lost if
//      the code is regenerated.
//  </auto-generated>
// ------------------------------------------------------------------------------
#region Designer generated code
#pragma warning disable
namespace Automation_Elluminate.Features
{
    using Reqnroll;
    using System;
    using System.Linq;
    
    
    [System.CodeDom.Compiler.GeneratedCodeAttribute("Reqnroll", "2.0.0.0")]
    [System.Runtime.CompilerServices.CompilerGeneratedAttribute()]
    [Microsoft.VisualStudio.TestTools.UnitTesting.TestClassAttribute()]
    public partial class AdministrationUrlSettingsFeature
    {
        
        private global::Reqnroll.ITestRunner testRunner;
        
        private Microsoft.VisualStudio.TestTools.UnitTesting.TestContext _testContext;
        
        private static string[] featureTags = new string[] {
                "Administration",
                "UrlSettings"};
        
        private static global::Reqnroll.FeatureInfo featureInfo = new global::Reqnroll.FeatureInfo(new System.Globalization.CultureInfo("en-US"), "Features", "AdministrationUrlSettings", null, global::Reqnroll.ProgrammingLanguage.CSharp, featureTags);
        
#line 1 "AdministrationUrlSettings.feature"
#line hidden
        
        public virtual Microsoft.VisualStudio.TestTools.UnitTesting.TestContext TestContext
        {
            get
            {
                return this._testContext;
            }
            set
            {
                this._testContext = value;
            }
        }
        
        [Microsoft.VisualStudio.TestTools.UnitTesting.ClassInitializeAttribute()]
        public static async System.Threading.Tasks.Task FeatureSetupAsync(Microsoft.VisualStudio.TestTools.UnitTesting.TestContext testContext)
        {
        }
        
        [Microsoft.VisualStudio.TestTools.UnitTesting.ClassCleanupAttribute(Microsoft.VisualStudio.TestTools.UnitTesting.ClassCleanupBehavior.EndOfClass)]
        public static async System.Threading.Tasks.Task FeatureTearDownAsync()
        {
        }
        
        [Microsoft.VisualStudio.TestTools.UnitTesting.TestInitializeAttribute()]
        public async System.Threading.Tasks.Task TestInitializeAsync()
        {
            testRunner = global::Reqnroll.TestRunnerManager.GetTestRunnerForAssembly(featureHint: featureInfo);
            if (((testRunner.FeatureContext != null) 
                        && (testRunner.FeatureContext.FeatureInfo.Equals(featureInfo) == false)))
            {
                await testRunner.OnFeatureEndAsync();
            }
            if ((testRunner.FeatureContext == null))
            {
                await testRunner.OnFeatureStartAsync(featureInfo);
            }
        }
        
        [Microsoft.VisualStudio.TestTools.UnitTesting.TestCleanupAttribute()]
        public async System.Threading.Tasks.Task TestTearDownAsync()
        {
            await testRunner.OnScenarioEndAsync();
            global::Reqnroll.TestRunnerManager.ReleaseTestRunner(testRunner);
        }
        
        public void ScenarioInitialize(global::Reqnroll.ScenarioInfo scenarioInfo)
        {
            testRunner.OnScenarioInitialize(scenarioInfo);
            testRunner.ScenarioContext.ScenarioContainer.RegisterInstanceAs<Microsoft.VisualStudio.TestTools.UnitTesting.TestContext>(_testContext);
        }
        
        public async System.Threading.Tasks.Task ScenarioStartAsync()
        {
            await testRunner.OnScenarioStartAsync();
        }
        
        public async System.Threading.Tasks.Task ScenarioCleanupAsync()
        {
            await testRunner.CollectScenarioErrorsAsync();
        }
        
        public virtual async System.Threading.Tasks.Task FeatureBackgroundAsync()
        {
#line 4
#line hidden
#line 5
    await testRunner.GivenAsync("We are at the Sign In page", ((string)(null)), ((global::Reqnroll.Table)(null)), "Given ");
#line hidden
        }
        
        [Microsoft.VisualStudio.TestTools.UnitTesting.TestMethodAttribute()]
        [Microsoft.VisualStudio.TestTools.UnitTesting.DescriptionAttribute("EL-11302.01 Verify URL Settings for Allow In Progress on Issues")]
        [Microsoft.VisualStudio.TestTools.UnitTesting.TestPropertyAttribute("FeatureTitle", "AdministrationUrlSettings")]
        [Microsoft.VisualStudio.TestTools.UnitTesting.TestCategoryAttribute("Administration")]
        [Microsoft.VisualStudio.TestTools.UnitTesting.TestCategoryAttribute("UrlSettings")]
        [Microsoft.VisualStudio.TestTools.UnitTesting.TestCategoryAttribute("Settings")]
        [Microsoft.VisualStudio.TestTools.UnitTesting.TestCategoryAttribute("PassesOnSecondRun")]
        public async System.Threading.Tasks.Task EL_11302_01VerifyURLSettingsForAllowInProgressOnIssues()
        {
            string[] tagsOfScenario = new string[] {
                    "Settings",
                    "PassesOnSecondRun"};
            System.Collections.Specialized.OrderedDictionary argumentsOfScenario = new System.Collections.Specialized.OrderedDictionary();
            global::Reqnroll.ScenarioInfo scenarioInfo = new global::Reqnroll.ScenarioInfo("EL-11302.01 Verify URL Settings for Allow In Progress on Issues", null, tagsOfScenario, argumentsOfScenario, featureTags);
#line 8
this.ScenarioInitialize(scenarioInfo);

[304NotModified]

Yes that's I meant, thanks!

So Reqnroll sets the correct DescriptionAttribute, but I don't know TechTalk.SpecRun.ScenarioAttribute

Was this with the specrun+ runner (not sure if that is the correct name) instead of mstest?

[304NotModified]

I think we should set https://learn.microsoft.com/en-us/dotnet/api/microsoft.visualstudio.testtools.unittesting.testmethodattribute.displayname?view=mstest-net-3.8

[terrimitchell]

yes it was the specrun runner, but both files I showed you I opened in VS 2022.... the specrun one worked fine, the reqnroll one does this weird conversion of test names which is just plain ugly and makes the navigation break.

[clrudolphi]

I think we should set https://learn.microsoft.com/en-us/dotnet/api/microsoft.visualstudio.testtools.unittesting.testmethodattribute.displayname?view=mstest-net-3.8

Submitted PR #588 to do just this.

[304NotModified]

As a result, we can no longer double-click on a test or even choose the "Go to test" option when right-clicking

This is probably something else. There are unfortunately multiple issues with navigation in VS2022, especially with .NET framework. See reqnroll/Reqnroll.VisualStudio#75

These are hard to fix unfortunately

[terrimitchell]

as I wrote though, I have no issues when opening the specflow version of the files in 2022, but I do have the problem in reqnroll