Incremental Reads always reads the last datetime partition instead of skipping it #48406
Unanswered
octopyth
asked this question in
Low-code Framework
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I am following the Low-Code CDK tutorial
https://docs.airbyte.com/connector-development/config-based/tutorial/incremental-reads
At step 5 Incremental Reads,
I set sample_state.json to
when I run
I get
Every time I run the connector it always reads the record for the last date partition, even though it has been already read.
In the tutorial the expected behaviour is to read 0 records
I replicated this behaviour in the No-Code CDK and it always reads the last stream_slice stored in the state.
Am I doing something wrong, or is this behaviour the new normal, considered a feature, not a bug?
Thanks!
Beta Was this translation helpful? Give feedback.
All reactions