Stop sync from an API when a certain number of pages is reached #48594
Unanswered
pai911
asked this question in
Connector Builder
Replies: 2 comments 6 replies
-
https://docs.airbyte.com/connector-development/config-based/understanding-the-yaml-file/pagination#cursor |
Beta Was this translation helpful? Give feedback.
0 replies
-
@szemek thank you for the response! but actually, i do know how to use cursor and stop condition. The problem is that in the stop condition, I can't check the current page num so I can't make the sync stop when a certain number of pages has been reached. Could you shade some lights on this? |
Beta Was this translation helpful? Give feedback.
6 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi! We're trying Airbyte to download data from some API.
This API support cursor-based pagination
So we perform sync every day, and each time we want to only paginate through the first N pages.
However, I can't get my head around doing this by using the connector builder.
Is it possible to make sync stop when a certain number of pages is reached with connector builder or even low-code builder?
Is there a way for me to define a custom variable and keep increment it by myself so I can use it in the stop condition?
Thank you!
Beta Was this translation helpful? Give feedback.
All reactions