Improve the log file handling

[konradkonrad]

Analysis

Current State

In our CI environment we have a runner-script that runs scenarios. After all scenario_player run commands have finished, we gzip the logfiles (scenario-player as well as node logs) as a means of storage optimization.

Problem

The problem is, that our script calls a very broad

find /data -type f -iname '*.log' | parallel gzip -q

If, for some reason, a second instance of the runner-script is executed, this can lead to truncated log-files that are gzipped while still being written to (see #677).

Solution

We should either

• collect all paths to logfiles that need to be compressed by explicitly creating them in the runner-script and pass them as execution parameters OR
• change the find command to be more explicit