Big Ideas

Big Ideas

• SqueeSAR module for PySAR
• Run code on different HPC platforms (pegasus, wrangler, AWS), controlled from a RSMAS VM
• Quick overview over status of system/access to error files
• Final data products should be available on the Cloud
• User's should be able to examine intermittent pysar products on Cloud
• Ability to install/run entire code on a variety of platforms (Mac, Linux, possible windows) when visiting volcano observatories anywhere

Others:

• add generate_template to process_sentinel
• Get code to work on AWS (who?)

Others:

• dockerize everything

Also See Yunjun's ideas at: https://sites.google.com/site/rsmasgeodesywiki/people/joshua-zahner

Next version of process_rsmas.py

generate_rsmas_run_files.py

run_1_download

ssara_rsmas.py $TEMPLATE/AgungSenDT32.template |& tee >! out_ssara.log dem_rsmas.py $TEMPLATE/AgungSenDT32.template | >!out_dem_rsmas.log

run_2_process

sentinelStack_rsmas.py $TEMPLATE/AgungSenDT32.template (create_stack_sentinel_run_files)

    clean_for_process

    sentinelStack

    execute_run_files

run_3_pysar

pysarApp.py $TEMPLATE/AgungSenDT32.template

run_4_insarmaps

ingest_insarmap.py $TEMPLATE/AgungSenDT32.template

# execute_rsmas_run_files.py

for item in run_file_list: createBatch.pl

It should create one or more files similar to this:

download_ssara_rsmas.py $SAMPLELSDIR/GalapagosSenDT128.template

downlaod_asfserial_rsmas.py $SAMPLELSDIR/GalapagosSenDT128.template

dem_rsmas.py $SAMPLELSDIR/GalapagosSenDT128.template

stacksentinel_rsmas.py $SAMPLELSDIR/GalapagosSenDT128.template

execute_run_files.py $SAMPLELSDIR/GalapagosSenDT128.template

pysarApp.py $SAMPLELSDIR/GalapagosSenDT128.template

ingest_insamaps.py $SAMPLELSDIR/GalapagosSenDT128.templat

geodmod.py $SAMPLELSDIR/GalapagosSenDT128.template

It has been accomplished with following options: (Sara 10/10/2018)

example:

process_rsmas.py DIR/TEMPLATEFILE [options] [--bsub]

[--startmakerun] # skips data downloading using SSARA

[--startprocess] # skips data downloading and making run files

[--startpysar] # skips InSAR processing (needs a 'merged' directory)

[--startinsarmaps] # skips pysar processing (needs a PYSAR directory)

[--startjobstats] # skips insarmaps processing (summarizes job statistics)

[--stopsara] # stops after ssara

[--stopmakerun] # stops after making run files

[--stopprocess] # stops after process

[--stoppysar] # stops after time series analysis

[--stopinsarmaps] # stops after insarmaps upload

[--startssara] # [default]

[--insarmaps] # append after other options to upload to insarmaps.miami.edu

[--bsub] # submits job using bsub (and send email when done)

[--nomail] # suppress emailing imagefiles of results (default is emailing)

[--restart] # removes project directory before starting download

You can separately run processing step and execute run files by:

"execute_rsmas_run_files.py templatefile starting_run stopping_run"

Example for running run 1 to 4:

execute_rsmas_run_files.py $TE/template 1 4