Skip to content

[FLINK-34099][tests] Harden and disable CheckpointIntervalDuringBacklogITCase - #27630

Merged
rkhachatryan merged 2 commits into
apache:masterfrom
rkhachatryan:f34099
Feb 18, 2026
Merged

rkhachatryan merged 2 commits into
apache:masterfrom
rkhachatryan:f34099

Conversation

@rkhachatryan

@rkhachatryan rkhachatryan commented Feb 17, 2026

Copy link
Copy Markdown
Contributor

There are a few issues with both production code and test.

  1. Test is too short and has low chances to catch any bugs
  2. In fact, a checkpoint IS triggered during backlog; but triggering fails because the 2nd source is slow to startup
  3. The 2nd source is slow to start due to busy wait

After FLINK-38940, it became more flaky because CheckpointCoordinator now waits for all tasks running.
And even more with FLINK-38939, which schedules the checkpoint faster.

Production code issues:

  1. The first checkpoint is triggered regardless of backlog
  2. Special triggering branch is not integrated with start/stop scheduling
  3. Decision logic about triggering is now spread between CheckpointCoordinator, CheckpointRequestDecider

This change adjusts the test so that it catches bug (1) more reliably.
(Expected) Test failure: https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=72468&view=logs&j=5c8e7682-d68f-54d1-16a2-a09310218a49&t=9d734c8c-6253-55e6-3bce-47e7cdf68ac4&l=40053

@rkhachatryan rkhachatryan changed the title [FLINK-34099] De-stabilize CheckpointIntervalDuringBacklogITCase [FLINK-34099][tests] De-stabilize CheckpointIntervalDuringBacklogITCase Feb 17, 2026
@rkhachatryan rkhachatryan changed the title [FLINK-34099][tests] De-stabilize CheckpointIntervalDuringBacklogITCase (do not merge) [FLINK-34099][tests] De-stabilize CheckpointIntervalDuringBacklogITCase Feb 17, 2026
@flinkbot

flinkbot commented Feb 17, 2026

Copy link
Copy Markdown
Collaborator

CI report:

Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

@rkhachatryan rkhachatryan changed the title (do not merge) [FLINK-34099][tests] De-stabilize CheckpointIntervalDuringBacklogITCase [FLINK-34099][tests] De-stabilize CheckpointIntervalDuringBacklogITCase Feb 18, 2026
@rkhachatryan rkhachatryan changed the title [FLINK-34099][tests] De-stabilize CheckpointIntervalDuringBacklogITCase [FLINK-34099][tests] Harden and disable CheckpointIntervalDuringBacklogITCase Feb 18, 2026
@rkhachatryan
rkhachatryan marked this pull request as ready for review February 18, 2026 13:18
There are a few issues with both production code and test.

Test problems:
1. The test is too short (20 records vs 100 ms checkpoint interval)
  and has low chances to catch any bugs
2. In fact, a checkpoint IS triggered during backlog;
  but triggering fails because the 2nd source is slow to startup
3. The 2nd source is slow to start due to busy wait

After FLINK-38940, it became more flaky because CheckpointCoordinator
now waits for all tasks running.
And even more with FLINK-38939, which schedules the checkpoint
faster.

This change adjusts the test so that it catches bug more reliably.
@rkhachatryan

Copy link
Copy Markdown
Contributor Author

cc @yunfengzhou-hub

@davidradl

Copy link
Copy Markdown
Contributor

@flinkbot run azure

@1996fanrui 1996fanrui left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for reproducing it reliably and ignoring the flaky test to ensure the CI stability, LGTM.

Since this PR does not fix the bug, how about creating a new jira to follow up how to fix the prod bug properly?

@rkhachatryan

rkhachatryan commented Feb 18, 2026

Copy link
Copy Markdown
Contributor Author

Thanks for the review

how about creating a new jira to follow up how to fix the prod bug properly?

I have updated FLINK-34099 ticket to reflect that it's a production code problem.
Not sure that we need another ticket, but I can create one for extra clarity

edit: created FLINK-39108

@rkhachatryan

Copy link
Copy Markdown
Contributor Author

Test failure unrelated:
https://issues.apache.org/jira/browse/FLINK-39117

Merging

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants