Author: Connor McArthur ([email protected])
This is a Singer tap that produces JSON-formatted data following the Singer spec.
It:
- Generates a catalog of available data in gnip
- Extracts the following resources:
- Install
git clone [email protected]:fishtown-analytics/tap-gnip.git
cd tap-gnip
pip install .- Get credentials from gnip. You'll need to:
- create an OAuth app
- get the app key, app secret, client ID, and client secret. Save these -- you'll need them in the next step.
- Create the config file.
There is a template you can use at config.json.example, just copy it to config.json in the repo root and insert your client ID and secret.
- Run the application to generate a catalog.
tap-gnip -c config.json --discover > catalog.json- Select the tables you'd like to replicate
Step 4 a file called catalog.json that specifies all the available endpoints and fields. You'll need to open the file and select the ones you'd like to replicate. See the Singer guide on Catalog Format for more information on how tables are selected.
- Run it!
tap-gnip -c config.json --properties catalog.jsonCopyright © 2018 Fishtown Analytics