-
Notifications
You must be signed in to change notification settings - Fork 1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug] streaming read by from-timestamp
may be occur exception(snapshot file not fund) sometimes
#3479
Comments
@Mr-j-yangyu Have you try to point to a safer timestamp to read (keep a margin from the oldest snapshot/changelog)? |
@Aitozi It is necessary to read earliest snapshot or changelog in some usage scenarios. |
Hi, @Mr-j-yangyu Could you give the detailed minimal reproduce step? The code in this picture will get earliest+1 snapshot in the end. |
Hi, @Mr-j-yangyu @discivigour I have found similar issue with SnapshotManager#earlierOrEqualTimeMills. An exception will be thrown complaining about the snapshot file does not exist. It is a bit difficult to reproduce because it only happens when the earliest snapshot expires between step1 and step 2 in the code picture. |
Hi, I tried to raise a fix for this problem in #4930. PTAL. |
Search before asking
Paimon version
0.8
Compute Engine
Flink
Minimal reproduce step
Analyze source code in
SnapshotManager.class
when read earliest snapshot file at step2, the snapshot maybe expired and deleted
What doesn't meet your expectations?
query job will failed by throw FileNotFoundException
Anything else?
No response
Are you willing to submit a PR?
The text was updated successfully, but these errors were encountered: