Preview version problems: working with TfsNodeStructureTool and WorkItemTypeMappingTool

[yaronbsmtx]

I am trying a simple migration of a project from one Azure DevOps organization to another.
I am using the v16.0.0-Preview.9 version because the latest release has the Serilog problem.
The source is based on the Agile process so I created an empty target with a process template inherited from Agile.
I pass the authentication phase but the migration fails after 3 errors comprised of 2 types:

1. System.Exception: WARNING: Unable to find 'Product Backlog Item' in the target project. Most likley this is due to a typo in the .json configuration under WorkItemTypeDefinition!

But no item in the source is of this type and the items having this issue are User stories.

2. Work Item is not ready to save as it has some invalid fields.

This may be related to custom iterations and areas I have in the source.
But the documentation does not seem to address the new config format.

Any help would be appreciated.

[MrHinsh]

I'm not aware of any "latest release has the Serilog problem" with the latest release...

Ahh, found what you are referring to. You are likely downloading the zip file and unpacking it. This runs through different security on windows and your security is blocking those files.

Solution: You need to unblock the zip before you unpck it it works... or you can unblock the individual files... its Serilog.Sinks.ApplicationInsights.dll and Serilog.Sinks.Console.dll if I remember....

[nkdagility-actions-bot[bot]]

Hi there,

ACTION REQUIRED

In order for us to help you will need to provide both the log, and the configration file that you are using.

Generate and Attach Log

Steps:

1. In the Config file, change LogLevel to Debug.
2. Identify a work item ID that exhibits this issue and create a query that only selects this work item.
3. Delete any existing copy of that work item from the target.
4. Run the migration.
5. Comment here with the full Log attached as well as the full (redacted) configration file that you are using.

Your assistance is greatly appreciated!

Thanks, Azure DevOps Migration Tools team

[MrHinsh]

System.Exception: WARNING: Unable to find 'Product Backlog Item' in the target project. Most likley this is due to a typo in the .json configuration under WorkItemTypeDefinition!

This is most likely a config issue. When you generate the sample configs with init it will add the following:

{
  "MigrationTools": {
    "CommonTools": {
      "WorkItemTypeMappingTool": {
        "Enabled": "True",
        "Mappings": {
          "User Story": "Product Backlog Item"
        }
      }
    }
  }
}

If the Source and Target are both Agile then you should remove the listed sample mapping?

Documenation for this is on WorkItemTypeMappingTool/)

[MrHinsh]

Work Item is not ready to save as it has some invalid fields.

Mostly this is a config issue, and I would need to see the config to comment... but its documented extensively on TfsNodeStructureTool.

The sample would look like:

    {
  "MigrationTools": {
    "CommonTools": {
      "TfsNodeStructureTool": {
        "Areas": {
          "Filters": [
            "*\\Team 1,*\\Team 1\\**"
          ],
          "Mappings": {
            "^7473924d-c47f-4089-8f5c-077c728b576e([\\\\]?.*)$": "MigrationTest5$1",
            "^migrationSource1([\\\\]?.*)$": "MigrationTest5$1",
            "^Skypoint Cloud([\\\\]?.*)$": "MigrationTest5$1"
          }
        },
        "Enabled": "True",
        "Iterations": {
          "Filters": [
            "*\\Sprint*",
            "*\\Sprint*\\**"
          ],
          "Mappings": {
            "^7473924d-c47f-4089-8f5c-077c728b576e([\\\\]?.*)$": "MigrationTest5$1",
            "^migrationSource1([\\\\]?.*)$": "MigrationTest5$1",
            "^Skypoint Cloud([\\\\]?.*)$": "MigrationTest5$1"
          }
        },
        "ReplicateAllExistingNodes": "True",
        "ShouldCreateMissingRevisionPaths": "True"
      }
    }
  }
}

Likley you don't need the filters (scopes the Area and Iteration migration), and the Mpapings here assume that there are work items that have been moved from the projects migrationSource1, Skypoint Cloud, and the now deleted project 7473924d-c47f-4089-8f5c-077c728b576e to the actual source.

The docs show both the default and the sample data... The deafult is applied before your customisations, and the sample is only used to generate documentation samples and init files...

[yaronbsmtx]

I am a Project collection administrator and Project administrator in both source and target.
As this is my first attempt, I limited myself to the simplest possible migration: the same process (or at least the same process parent since I have to create an inherited child at the target), the same project name, no mappings etc. I attached my config here.
configuration - debug.json

[MrHinsh]

The log ouputs the exact data that is causing the issue... if you check the log for "WRN" and then look around that warning you should be able to see what caused the error.

[yaronbsmtx]

These are the only WRNs in the log file:

Line  20: [23:22:14 WRN] [15.2.1] WorkItemMigrationContext::InternalExecute: teamSettingsEnricher is disabled!
Line  32: [23:22:33 WRN] [15.2.1] TfsUserMappingEnricher is disabled in settings. You may have users in the source that are not mapped to the target. 
Line  48: [23:22:34 WRN] [15.2.1] The field Microsoft.VSTS.Common.ClosedDate is set to Null and will revert to the current date on save! 
Line  49: [23:22:34 WRN] [15.2.1] Source Closed Date [#18][Rev3]: "2024-09-04T16:39:22.5830000+03:00" 
Line  53: [23:22:35 WRN] [15.2.1]   [SKIP] Unable to migrate link where Link of type System.LinkTypes.Hierarchy-Reverse where wiSourceL=18, wiSourceR=15, wiTargetL=1, wiTargetR=15 as target WI has not been migrated
Line  70: [23:22:40 WRN] [15.2.1]   [SKIP] Unable to migrate link where Link of type System.LinkTypes.Hierarchy-Reverse where wiSourceL=19, wiSourceR=16, wiTargetL=2, wiTargetR=16 as target WI has not been migrated
Line 106: [23:22:46 WRN] [15.2.1]   [SKIP] Unable to migrate link where Link of type System.LinkTypes.Hierarchy-Reverse where wiSourceL=20, wiSourceR=16, wiTargetL=4, wiTargetR=16 as target WI has not been migrated
Line 119: [23:22:47 WRN] [15.2.1]   [SKIP] Unable to migrate link where Link of type System.LinkTypes.Hierarchy-Reverse where wiSourceL=17, wiSourceR=15, wiTargetL=5, wiTargetR=15 as target WI has not been migrated
Line 132: [23:22:48 WRN] [15.2.1]   [SKIP] Unable to migrate link where Link of type System.LinkTypes.Hierarchy-Reverse where wiSourceL=16, wiSourceR=14, wiTargetL=6, wiTargetR=14 as target WI has not been migrated
Line 155: [23:22:59 WRN] [15.2.1]   [SKIP] Unable to migrate link where Link of type System.LinkTypes.Hierarchy-Reverse where wiSourceL=15, wiSourceR=14, wiTargetL=7, wiTargetR=14 as target WI has not been migrated
Line 274: [23:23:24 WRN] [15.2.1]   [SKIP] Unable to migrate link where Link of type System.LinkTypes.Hierarchy-Reverse where wiSourceL=3, wiSourceR=1, wiTargetL=12, wiTargetR=1 as target WI has not been migrated
Line 295: [23:23:26 WRN] [15.2.1]   [SKIP] Unable to migrate link where Link of type System.LinkTypes.Hierarchy-Reverse where wiSourceL=2, wiSourceR=1, wiTargetL=13, wiTargetR=1 as target WI has not been migrated
Line 345: [23:23:38 WRN] [15.2.1]   [SKIP] Unable to migrate link where Link of type System.LinkTypes.Hierarchy-Reverse where wiSourceL=5, wiSourceR=4, wiTargetL=15, wiTargetR=4 as target WI has not been migrated

[MrHinsh]

Can you post your log. The error right before the app stops tells you exactly what the field was that caused the error and what the value was. Most likely its an "Area or Iteration" that does not exist that was not caught at validation time.

Solution: Add a mapping for it following the documentation.

[yaronbsmtx]

Some of the areas in the source most definitely did not exist in the target.
But the tool created all of them and assigned them correctly to all items except one.
So I am not sure whether you always need to map all the areas or not.

I attached the full log [file.](migration-3.log)