copy-webpack-plugin with pnp doesn't work since ESM migration

[timja]

It looks similar to https://canary.discord.com/channels/226791405589233664/654372321225605128/931568184274878535 and webpack-contrib/copy-webpack-plugin#643

Error [ERR_MODULE_NOT_FOUND]: Cannot find package 'globby' imported from /private/tmp/template-expressjs/skeleton/.yarn/__virtual__/copy-webpack-plugin-virtual-22efb53722/0/cache/copy-webpack-plugin-npm-11.0.0-9a07415855-df4f8743f0.zip/node_modules/copy-webpack-plugin/dist/index.js
Did you mean to import globby-npm-13.1.2-3d26efd428-c148fcda0c.zip/node_modules/globby/index.js?
    at new NodeError (node:internal/errors:387:5)
    at packageResolve (node:internal/modules/esm/resolve:951:9)
    at moduleResolve (node:internal/modules/esm/resolve:1000:20)
    at defaultResolve (node:internal/modules/esm/resolve:1214:11)
    at nextResolve (node:internal/modules/esm/loader:165:28)
    at ESMLoader.resolve (node:internal/modules/esm/loader:844:30)
    at ESMLoader.getModuleJob (node:internal/modules/esm/loader:431:18)
    at ESMLoader.import (node:internal/modules/esm/loader:528:22)
    at importModuleDynamically (node:internal/modules/cjs/loader:1065:29)

repo is https://github.com/hmcts/expressjs-template
commit: a79475e16f418d0fc6bffcb347ad094c9a076be3

This was supposed to be fixed with yarn 3.2 but doesn't seem to work for 3.2.3
Any ideas?
Thanks!