Problem with GLTF SkinnedMesh and individually changing materials and nodes

[enijar]

I know this isn't an issue with r3f, but I've searched around for a solution to this problem for days and I'm stuck for where else to turn...

Expected Result

A component loads the given GLTF file, changes some of the the texture colours and changes the visibility of some nodes. This component will be re-used with different props for different user avatars, e.g. a man with brown hair, a woman with blond hair, etc.

The Problem

When using SkeletonUtils.clone, changing the GLTF nodes/materials has no effect. It just loads the base model.

Working Demo

I have a working demo of this issue on CodeSandbox which shows the problem I'm having.

[enijar]

So, I found a workaround but this feels very hacky. Resolved demo here.

Does anyone know a better way to solve this?