Get-PnPLargeListOperationStatus returns Invalid WorkItem when trying to remove large lists

[FrancisBuyse]

I have a couple of libraries with more than 2 million documents that I want to permanently delete.
When using the Remove-PnpList command a timerjob is being created.
when executing the Get-PnPLargeListOperationStatus it returns notStarted at first, but after some time I get Invald WorkItem as result and nothing changes on the large lists