Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Solve executor state mismatch / task killed externally #44151

Open
1 task done
dstandish opened this issue Nov 18, 2024 · 0 comments
Open
1 task done

Solve executor state mismatch / task killed externally #44151

dstandish opened this issue Nov 18, 2024 · 0 comments
Labels
area:core area:logging kind:meta High-level information important to the community

Comments

@dstandish
Copy link
Contributor

dstandish commented Nov 18, 2024

Body

Users have long been confused by log messages along the lines of "task state changed externally", or something about executor state mismatch, where the thing that emits the log is essentially saying, 🤷 , no clue what happened sorry.

E.g. see here https://airflow.apache.org/docs/apache-airflow/stable/troubleshooting.html#task-state-changed-externally

This should mostly be avoidable.

If a task was killed by external user action, why do we not have a signal of that recorded somewhere (e.g. on the TI object or in event log), and why can't the executor (or task process or whatever) see that and then either not have to log such a message, or log a more helpful one that says exactly what happened.

Committer

  • I acknowledge that I am a maintainer/committer of the Apache Airflow project.
@dstandish dstandish added the kind:meta High-level information important to the community label Nov 18, 2024
@dstandish dstandish changed the title Executor state mismatch / task killed externally Solve executor state mismatch / task killed externally Nov 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:core area:logging kind:meta High-level information important to the community
Projects
None yet
Development

No branches or pull requests

1 participant