Repository navigation
Keep scheduling remaining tasks when a running Dag is paused - #71765
NihalRadhakrishna wants to merge 2 commits into
Conversation
|
Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contributors' Guide
|
|
did you read this -> #71384 (comment) ? |
|
Apologies for not addressing your earlier comment. If we don't want to change the behavior of the current Pause DAG button, as you suggested, we could give users two options when they click pause:
Unpause would resume current and new dag runs. Open to suggestions on the best way to approach this. |
|
Closing this. Pausing is documented to keep downstream tasks in |
1. Problem
Pausing a Dag stopped the scheduler from examining already-running Dag runs and from enqueueing remaining
scheduledtasks. In-flight work froze until unpaused, even though running tasks were allowed to finish. As a result,a running Dag could remain running indefinitely because its downstream tasks would never be queued.
closes: #71381
2. Solution
Cleanup
_update_dag_run_state_for_paused_dags(and its 60s timer). Paused running Dag runs are now examined in the main scheduler loop, so a separateupdate_statepass was redundant.Tests
Was generative AI tooling used to co-author this PR?
Generated-by: Cursor Grok 4.6 following the guidelines
{pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.