Optimize processing parameters using --remora of TACC for run/resources information:

[falkamelung]

Info on TACCs remora is here: https://github.com/TACC/remora :

Steps to see remora results:

1. get previous create_runfiles.py command using gcl alias grep create log in project directory
2. Clean directory using rmStack alias
3. rerun create_runfiles.py with --remora option:

create_runfiles.py $TE/B3KanpurSenD165.template --jobfiles --queue skx --no-tmp --remora

The will run job_submission.py with --remora option, e.g.

job_submission.py --template $TE/B3KanpurSenD165.template $SCRATCHDIR/B3KanpurSenD165/run_files/run_04_fullBurst_geo2rdr --outdir $SCRATCHDIR/B3KanpurSenD165 --numMemoryUnits 3 --writeonly --remora

(you' find this command in log)
4. Rerun processing using:

minsarApp.bash $TE/B3KanpurSenD165.template --start ifgram

5. Possibly upload remora directories to jetstream for display:

upload_remora_dirs.py run_files/remora_*

6. display HTML on jetstream:

cat remora_upload.log
http://149.165.154.65/data/HDF5EOS/B3KanpurSenD165/run_files/remora_run_01_unpack_topo_reference_0/remora_summary.html
http://149.165.154.65/data/HDF5EOS/B3KanpurSenD165/run_files/remora_run_02_unpack_secondary_slc_0/remora_summary.html
http://149.165.154.65/data/HDF5EOS/B3KanpurSenD165/run_files/remora_run_03_average_baseline_0/remora_summary.html
http://149.165.154.65/data/HDF5EOS/B3KanpurSenD165/run_files/remora_run_04_fullBurst_geo2rdr_0/remora_summary.html
http://149.165.154.65/data/HDF5EOS/B3KanpurSenD165/run_files/remora_run_05_fullBurst_resample_0/remora_summary.html
http://149.165.154.65/data/HDF5EOS/B3KanpurSenD165/run_files/remora_run_06_extract_stack_valid_region_0/remora_summary.html
http://149.165.154.65/data/HDF5EOS/B3KanpurSenD165/run_files/remora_run_07_merge_reference_secondary_slc_0/remora_summary.html
http://149.165.154.65/data/HDF5EOS/B3KanpurSenD165/run_files/remora_run_08_generate_burst_igram_0/remora_summary.html
http://149.165.154.65/data/HDF5EOS/B3KanpurSenD165/run_files/remora_run_08_generate_burst_igram_1/remora_summary.html
http://149.165.154.65/data/HDF5EOS/B3KanpurSenD165/run_files/remora_run_09_merge_burst_igram_0/remora_summary.html
http://149.165.154.65/data/HDF5EOS/B3KanpurSenD165/run_files/remora_run_09_merge_burst_igram_1/remora_summary.html
http://149.165.154.65/data/HDF5EOS/B3KanpurSenD165/run_files/remora_run_10_filter_coherence_0/remora_summary.html
http://149.165.154.65/data/HDF5EOS/B3KanpurSenD165/run_files/remora_run_10_filter_coherence_1/remora_summary.html
http://149.165.154.65/data/HDF5EOS/B3KanpurSenD165/run_files/remora_run_11_unwrap_0/remora_summary.html
http://149.165.154.65/data/HDF5EOS/B3KanpurSenD165/run_files/remora_run_11_unwrap_1/remora_summary.html
http://149.165.154.65/data/HDF5EOS/B3KanpurSenD165/run_files/remora_run_11_unwrap_1/remora_summary.html

Additional commands in the jobfile can be added here:

[falkamelung]

Remora files

jetstream
cds
ls -1 B*Kan*/run_files/re*