Enhancements from Queensland Government fork

[ThrawnCA]

• Download archive to a temporary file if not already on disk, so we can do type sniffing. This is relevant when the file uploader goes to somewhere remote like S3.
• Use UTC timestamps internally so that times are stored correctly. They're stored in the database without timezone info, so if they were originally generated with a timezone, they'll come out wrong.
• Enable file downloads to optionally go through a proxy.
• Use BSD file fallback more consistently when other methods fail.
• Clean up for Flake8 and Python 3.
• Move dependencies into external requirements.txt instead of setup.py.

[ThrawnCA]

For some reason the CKAN versions aren't being respected and it's always running against master. Will look into what's needed to make it compatible with CKAN 2.9.x.

[Zharktas]

I'll probably have time in the near future to migrate QA to py3, some of these changes are probably done during that. Travis will be replaced by Github Actions, so I wouldn't use too much time maintaining travis scripts.

[ThrawnCA]

I'll probably have time in the near future to migrate QA to py3, some of these changes are probably done during that. Travis will be replaced by Github Actions, so I wouldn't use too much time maintaining travis scripts.

We made a start on converting to GitHub actions, and some of the resulting test fixes are in this pull request, but I wasn't able to make the last few tests pass (it was failing to determine the type of some of the sample files, for no reason I could identify, but it was consistent). I can submit our workflow if you want to review it.

[nickumia-reisys]

Hi @ThrawnCA and @Zharktas, are you guys planning on using this PR to do the PY3 and CKAN upgrades? My team (GSA/data.gov) is in the process of upgrading our applications to PY3 and CKAN 2.9 and since this is a dependency, I was curious if there were any updates on either of your ends regarding additional work here. I'd be happy to support the upgrade based on the current progress. In the coming weeks, we will be ramping up activity in this specific upgrade.

[ThrawnCA]

Hi @ThrawnCA and @Zharktas, are you guys planning on using this PR to do the PY3 and CKAN upgrades?

Actually, my organisation has a fork of this extension, https://github.com/qld-gov-au/ckanext-qa, which is what we'll use for upgrading.

This PR is just backporting some of our changes to upstream.

My team (GSA/data.gov) is in the process of upgrading our applications to PY3 and CKAN 2.9 and since this is a dependency, I was curious if there were any updates on either of your ends regarding additional work here. I'd be happy to support the upgrade based on the current progress. In the coming weeks, we will be ramping up activity in this specific upgrade.

There's a project happening right now that's putting the upgrade on hold at our end, but in a few months we'll likely focus on it in earnest. Sounds like you'll probably be done by then. Probably best if you collaborate with Zharktas.