-
Notifications
You must be signed in to change notification settings - Fork 5k
feat(source-twilio): Add configurable slice step duration (default: 1 month) #72494
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
feat(source-twilio): Add configurable slice step duration (default: 1 month) #72494
Conversation
👋 Greetings, Airbyte Team Member!Here are some helpful tips and reminders for your convenience. 💡 Show Tips and TricksPR Slash CommandsAirbyte Maintainers (that's you!) can execute the following slash commands on your PR:
📚 Show Repo GuidanceHelpful Resources
|
|
|
/publish-connectors-prerelease
|
|
Deploy preview for airbyte-docs ready! ✅ Preview Built with commit a6bbe83. |
|
/publish-connectors-prerelease
|
What
Resolves: https://github.com/airbytehq/oncall/issues/11078.
Adds a new
slice_step_durationconfiguration option that allows users to control the time window size for incremental sync slices. The default is changed from one year (P1Y) to one month (P1M), with options for 1 day, 1 week, 1 month, or 1 year.How
slice_step_durationconfig option in the spec with enum values: P1D (1 Day), P1W (1 Week), P1M (1 Month), P1Y (1 Year)stepparameter in two incremental sync cursor definitions to use{{ config.get('slice_step_duration', 'P1M') }}Review guide
airbyte-integrations/connectors/source-twilio/manifest.yaml- New config option and dynamic step parameterairbyte-integrations/connectors/source-twilio/metadata.yaml- Version bump to 0.17.5airbyte-integrations/connectors/source-twilio/unit_tests/test_streams.py- Test date range adjustmentdocs/integrations/sources/twilio.md- Changelog entryHuman Review Checklist
{{ config.get('slice_step_duration', 'P1M') }}works correctly in declarative manifestsUser Impact
Users can now configure the slice step duration for incremental syncs via the new "Slice Step Duration" option. Smaller windows (like 1 day or 1 week) may help avoid timeouts for accounts with large data volumes, while larger windows reduce the number of API requests. The default of 1 month provides a good balance for most use cases.
Can this PR be safely reverted and rolled back?