Skip to content

Commit

Permalink
update admin pipe to grab input data from their new home on s3
Browse files Browse the repository at this point in the history
  • Loading branch information
maxgrossman committed Sep 26, 2017
1 parent 3aa2351 commit 2bba1a3
Showing 1 changed file with 6 additions and 1 deletion.
7 changes: 6 additions & 1 deletion admin-tables-pipe.sh
Original file line number Diff line number Diff line change
@@ -1,6 +1,10 @@
# Synopysis: links a set of I/O geoprocessing scripts that transform a commune level shapefile of Vietnam admin areas
########### into three postgis tables at commune, district, and province levels/

# copy input shapefiles from the s3 bucket in which they live
echo --- downloading input boundaries from s3 ---
aws s3 cp s3://openroads-vn-boundaries ./data/input --recursive

# output directory that holds the final output of linked processes
OUT_DIR=./data/output
# the base processing directory that includes sub directories that I/O data for each process
Expand Down Expand Up @@ -62,6 +66,7 @@ do
# copy output contents to handoff directory for the next process to grab
cp -R ${PROCESS_DIR}/output/. ${HNDF_DIR}/
done
# clean up
# clean up temp directories and remove the input data
rm -rf ${HNDF_DIR}
rm -rf ${PROCESSING_BASE_DIR}
rm -f ./data/input/*

0 comments on commit 2bba1a3

Please sign in to comment.