Skip to content

CraveFood/psql2bigquery

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

37 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

PostgreSQL to BigQuery

Install with: pip install psql2bigquery

Get usage instructions with: psql2bigquery run --help

Sample usage

poetry run psql2bigquery run \
--db-host localhost \
--db-port 5432 \
--db-user username \
--db-password secret-password \
--db-name my_api \
--gcp-project my-project \
--gcp-dataset my_api \
--include table_name_a \
--include table_name_b \
--gcp-credential-path /path/to/credential.json

Logging

There's a possibility to use Sentry.io for error logging.

Just set the environment variable SENTRY_DSN and psql2bigquery will automatically configure the logger.

Additionally, the environment variable ENV can be used as Sentry environment.

Contributing

  • Fork this project
  • Install dependencies with make dependencies
  • You can test the client locally (without installing the package) with poetry run psql2bigquery <command>
  • Make a PR with as much details as possible