In flight md5 checksum #35
Description
The md5 sum is calculated and verified for 2 files:
- state.zst archive, after downloading the file
- state.sql, after unpacking the file
Calculating md5 sums for these files requires reading them from disk, which is slow. For both files, the md5sum could be calculated in parallel to downloading/unpacking, saving a lot on disk IO.