On-the-Fly Preprocessing

[jejjohnson]

We save the raw data and the preprocessed data. Each of the services we use have an option to directly load the data. This would save a lot of space and time because many times we wish to take a subset and then do the preprocessing.

However, there is a downside to datasets like GOES which downloads band per band which may fail halfway through

Example - nb