Remove gradle workaround

## What happened?
Gradle has slowly been changing the tasks they produce to be lazily configurable.  While this is great it also inadvertantly breaks some work around we had to lazily configure the non lazy tasks.

## What did you want to happen?
Once we raise the minimum version of gradle we support we should remove the workaround