Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DT sources monitoring #74

Open
3 tasks
caviri opened this issue Apr 8, 2024 · 0 comments
Open
3 tasks

DT sources monitoring #74

caviri opened this issue Apr 8, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@caviri
Copy link
Contributor

caviri commented Apr 8, 2024

Context
In order to monitor specific data sources we need to implement a way to monitor the status of these sources. The user can define a set of data sources (data-endpoints?) that are going to be checked automatically for updates.

Proposed solution
- Basic monitoring: If the URL provided is always the latest and the values are going to be updated there. Then odpt can use a simple check on the endpoing and calculate the hash in order to detect if the value changed.
- Custom monitoring: If the data endpoint requires an specific parsing and selection. Such as list of files on a page. The monitoring can be performed by an specialised component.

For this MVP I would just focus on the former case

Acceptance criteria

  • Generation of data endpoint to test
  • Implement of Basic monitoring on data endpoint
  • Trigger execution based on data update
@caviri caviri added the enhancement New feature or request label Apr 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant