Process raw data

This step is using two script, one to create run files and one to execute them: create_runfiles.py, execute_runfiles.py

run files are the steps to be done by ISCE (or any software in the future versions). They are from unpacking the data set up to interferograms or coregistered SLCs. There are different workflows in ISCE to process the data which mainly use two of them: interferogram and SLC For a full description of ISCE workflows refer to (https://github.com/isce-framework/isce2/tree/master/contrib/stack/topsStack)

Full list of other ISCE parameters for topStack processing is as follow:

################################# topsStack Parameters ####################################
topsStack.slcDir                   = auto         # [SLCs dir]
topsStack.orbitDir                 = auto         # [$SENTINEL_ORBITS]
topsStack.auxDir                   = auto         # [$SENTINEL_AUX]
topsStack.workingDir               = auto         # [/projects/scratch/insarlab/$USER/projname]
topsStack.demDir                   = auto         # [DEM file dir]
topsStack.master                   = auto         # [Master acquisition]
topsStack.numConnections           = auto         # number of interferograms with each image and next acquisitions, auto for 3
topsStack.numOverlapConnections    = auto         # [N of overlap Ifgrams for NESD. Default : 3]
topsStack.subswath                 = auto         # [List of swaths. Default : '1 2 3']
topsStack.boundingBox              = None         # [ '-1 0.15 -91.7 -90.9'] required
topsStack.textCmd                  = auto         # [eg: source ~/.bashrc]
topsStack.excludeDates             = auto         # [20080520,20090817 / no], auto for no
topsStack.includeDates             = auto         # [20080520,20090817 / no], auto for all
topsStack.azimuthLooks             = auto         # [1 / 2 / 3 / ...], auto for 5
topsStack.rangeLooks               = auto         # [1 / 2 / 3 / ...], auto for 9
topsStack.filtStrength             = auto         # [0.0-0.8] auto for 0.3
topsStack.esdCoherenceThreshold    = auto         # Coherence threshold for estimating az misreg using ESD. auto for 0.85
topsStack.snrMisregThreshold       = auto         # SNR threshold for estimating rng misreg using cross-correlation. auto for 10
topsStack.unwMethod                = auto         # [snaphu icu], auto for snaphu
topsStack.polarization             = auto         # SAR data polarization. auto for vv
topsStack.coregistration           = auto         # Coregistration options: a) geometry b) NESD. auto for NESD
topsStack.workflow                 = auto         # [interferogram / offset / slc / correlation] auto for interferogram
topsStack.startDate                = auto         # [YYYYMMDD]. auto for first date available
topsStack.stopDate                 = auto         # [YYYYMMDD]. auto for end date available
topsStack.useGPU                   = auto         # Allow App to use GPU when available [default: False]

After setting proper values to the parameters in the template file, by running create_runfiles.py, the corresponding run files based on the selected workflow will be created in the folder run_files Example:

create_runfiles.py $SAMPLESDIR/unittestGalapagosSenDT128.template

Now all run files have to be executed one by one sequentially using execute_runfiles.py. each step can be called separately by giving start/end options.

Example:

execute_runfiles.py $SAMPLESDIR/unittestGalapagosSenDT128.template      # will execute all run files one by one
execute_runfiles.py $SAMPLESDIR/unittestGalapagosSenDT128.template  --submit    # submits the script as a job
execute_runfiles.py $SAMPLESDIR/unittestGalapagosSenDT128.template  --start 1 --stop 10    # will execute all steps from run_1_* to run_10_*