[BUG] Get-PnPListItem fails on large lists using UniqueId

[HeKr09]

Reporting an Issue or Missing Feature

I try to scan SitePages for specific images and documents. Therefor I check the WebParts for example for an image WebPart.
Within the PropertiesJson I retrieve a uniqueId which seems to be the uniqueId of the image used.
So I tried to get the list item with Get-PnPListItem and the uniqueId which fails on large lists because the code seems to use a query to get the item. This means I run into the problem several people did have.
Is there any other way?

Expected behavior

I expected that the uniqueId would be easier to find than using a query.

Actual behavior

Get-PnPListItem : The attempted operation is prohibited because it exceeds the list view threshold.
At line:1 char:158
+ ... son.listId; Get-PnPListItem -List $list -UniqueId $json.uniqueId -Fie ...
+                 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : InvalidOperation: (:) [Get-PnPListItem], PSInvalidOperationException
    + FullyQualifiedErrorId : InvalidOperation,PnP.PowerShell.Commands.Lists.GetListItem

Steps to reproduce behavior

 $page.Controls | Where-Object Title -eq "Image" | ForEach-Object { $json = $_.PropertiesJson | ConvertFrom-Json; $list = Get-PnPList -Identity $json.listId; Get-PnPListItem -List $list -UniqueId $json.uniqueId; }

What is the version of the Cmdlet module you are running?

1.12.0

Which operating system/environment are you running PnP PowerShell on?

• Windows
• Linux
• MacOS
• Azure Cloud Shell
• Azure Functions
• Other : please specify

[github-actions[bot]]

This issue is stale because it has been open 14 days with no activity. Remove stale label or comment or this will be closed in 5 days

[gautamdsheth]

Hi, the unique ID column needs to be set as indexed before 5000 items get created.
By default, it is not.
You will have to create your own CAML query with indexed columns or use -PageSize and iterate.
Moving this to discussion.

You can refer to these links for how to handle large lists:

https://www.sharepointdiary.com/2016/12/sharepoint-online-get-all-items-from-large-lists-powershell-csom.html

https://www.sharepointdiary.com/2019/03/fix-get-pnplistitem-attempted-operation-prohibited-because-it-exceeds-list-view-threshold-enforced-by-administrator.html

https://sympmarc.com/2020/07/02/pnp-powershell-to-retrieve-sharepoint-list-items-get-pnplistitem-with-query/

[HeKr09]

Okay that works in some way. But now I got the problem that I linked a document within the "File Viewer" WebPart.
If I check the UniqueId within the JSON of the WebPart it differs from the UniqueId I receive while running this code:

$doc = Get-PnPListItem -List "Documents" -Id 318409 -Fields "GUID"
$doc["GUID"]

And yes: It is the same document :)
Also: If I run this code I do not get any match.
$items | Where-Object { $_["GUID"] -eq $itemUniqueId; } | Select-Object -First 1

[rohit404404]

I second this bug. Usually Get-PnPListItem works with Identity property, even on large lists. I was hoping it would work with UniqueID property too. There is no way to index this propertym since its internal field.

In my case i cannot use any other property, since this will add extra call to sharepoint list in the code where i am updating 150K files metadata. Any thoughts?