[FEATURE] View Tensorboard files while job is running

[shazraz]

Currently, we're only able to access tensorboard files for a job that has completed or failed. This prevents us from seeing tensorboard files for a job that is currently training which means we are unable to identify problems with a model or reason about it until the job is completed.