Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

In CBS executor, update markers table with streets and data from streets tables #2752

Open
atalyaalon opened this issue Dec 29, 2024 · 0 comments
Milestone

Comments

@atalyaalon
Copy link
Collaborator

atalyaalon commented Dec 29, 2024

When loading CBS data, the streets names are taken from CBS dictionary that comes with the CBS data.
For consistency we should use the streets table that's loaded from data-gov streets table.

  1. Update cbs executor.py code: when creating a marker, load the following fields from streets table: street1_hebrew, street2_hebrew, main_street, secondary_street, address, description

Only if street is not found in the data-gov streets table, use the given table that the CBS adds in given files

  1. Run backfill starting year 2013 just like we made in this airflow dag
@atalyaalon atalyaalon added this to the v0.18.0 milestone Dec 29, 2024
@atalyaalon atalyaalon changed the title In CBS Dataflow, update tables with streets and data from cities and streets tables In CBS Dataflow, update tables with streets and data from streets tables Dec 29, 2024
@atalyaalon atalyaalon changed the title In CBS Dataflow, update tables with streets and data from streets tables In CBS executor, update markers table with streets and data from streets tables Dec 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant