Cache dependencies of gpu runner #269
Description
The GPU runner downloads the runner image then install the required dependencies. This takes time and isn't cached, as the pod is detroyed after the training phase.
A possibility could be to create a docker image for the gpu runner that includes all the dependencies already, as an extra layer to the existing runner image.