Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Backsearch P1] Get the Land Ownership pipeline running #13

Open
lin-d-hop opened this issue May 7, 2024 · 0 comments
Open

[Backsearch P1] Get the Land Ownership pipeline running #13

lin-d-hop opened this issue May 7, 2024 · 0 comments
Assignees

Comments

@lin-d-hop
Copy link

lin-d-hop commented May 7, 2024

Description

There are a number of steps involved in updating the PBS:

  • Updating companies ownership data
  • Downloading and backing up INSPIRE data
  • Analysing the new INSPIRE data and matching

Acceptance Criteria

  1. All the steps are documented in the codebase docs
  2. The INSPIRE data updates are handled in such a way that we can re-run updates each month in case of an error or in case of improving our matching algorithms in the future.
  3. Basic monitoring and error handling so that we are notified if things go wrong, including if the INSPIRE backups fail due to server full.
  4. After each update a notification sent to element breaking down the updates

This is an example element output. This is documented in the code.
(index) │ count │ % │
├────────────────────────┼───────┼─────┤
│ exactMatchIds │ 0 │ NaN │
│ sameVerticesIds │ 0 │ NaN │
│ exactOffsetIds │ 0 │ NaN │
│ highOverlapIds │ 0 │ NaN │
│ boundariesShiftedIds │ 0 │ NaN │
│ mergedIds │ 0 │ NaN │
│ mergedIncompleteIds │ 0 │ NaN │
│ segmentedIds │ 0 │ NaN │
│ segmentedIncompleteIds │ 0 │ NaN │
│ mergedAndSegmentedIds │ 0 │ NaN │
│ newSegmentIds │ 0 │ NaN │
│ movedIds │ 0 │ NaN │
│ failedMatchIds │ 0 │ NaN │
│ newInspireIds │ 0 │ NaN │

@rogup rogup self-assigned this Dec 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants