Data Storage

Local Storage

Files that are downloaded for use by StEWI, and inventories that are generated by StEWI are maintained in the local user directory outside of the package. To check where the files are stored, run the following code in the python console:
import appdirs
appdirs.user_data_dir()

Each module that requires local data storage will use its own folder, e.g.,

• ../Local/stewi
• ../Local/stewicombo
• ../Local/facilitymatcher

Source data files are downloaded and processed within the stewi subfolder, e.g.,

• ../Local/stewi/TRI Data Files/

while processed inventories are stored in one of the following folders:

• ../Local/stewi/facility
• ../Local/stewi/flow
• ../Local/stewi/flowbyfacility
• ../Local/stewi/flowbyprocess

Remote Storage

Processed inventory files associated with the latest major release are stored are stored on Data Commons, an Amazon AWS s3 server. Data files are stored in parquet format, as this file type is smaller and faster to read than traditional file types, such as a csv.

Storing files on a remote server enables use of these files by other tools, such as flowsa, without requiring a user to generate them locally.