Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Endpoint for dag_run status #80

Open
6 tasks done
hannelita opened this issue Jul 28, 2020 · 1 comment
Open
6 tasks done

Endpoint for dag_run status #80

hannelita opened this issue Jul 28, 2020 · 1 comment
Labels
enhancement New feature or request
Milestone

Comments

@hannelita
Copy link
Contributor

hannelita commented Jul 28, 2020

Acceptance

  • <DAG_ID>/dag_run endpoint on CKAN which gives a report with the status of the DAG
  • Collect Airflow default API response for a DAG (for local and remote Airflow instances)

Note: This task won't provide any integration with GCP logs (see #69 ); it only collects the output of Airflow API

Tasks

  • Create endpoint; DAG_RUN is optional. If no DAG_RUN is specified, list the most recent dag_runs
  • If a DAG run is specified, retrieve info only for that particular RUN (note: when you trigger the DAG, the response brings the DAG_RUN (see /aircan_submit will take the DAG name #79)
  • Return Airflow API response (local Airflow)
  • Return Airflow API response (remote Airflow). It will require another integration with GCP
@rufuspollock
Copy link
Member

@hannelita could you update this issue quickly with some info on what status is and update e.g. acceptance with links to outputs / items justifying the completion status.

Then if everything is done can you closed as FIXED with a brief note 😄

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants