Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Flush/Clean Sync Records for Sync Run in FullRefresh Sync Mode #74

Open
afthabvp opened this issue Apr 23, 2024 · 0 comments
Open

Flush/Clean Sync Records for Sync Run in FullRefresh Sync Mode #74

afthabvp opened this issue Apr 23, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@afthabvp
Copy link
Collaborator

In FullRefresh sync mode, for every sync run, we fetch all records from the source and send them to the destination. Since there's no need to preserve the sync records once the data is moved to the destination, we need to flush or clean the sync records after each completed run.
@afthabvp afthabvp added the enhancement New feature or request label Apr 23, 2024
arp99 pushed a commit to arp99/multiwoven that referenced this issue May 3, 2024
@subintp
feat:rate limiting (Multiwoven#74)
8ca05f2 
* Add rate limit to catalog

* Add rate limit to stream

* Add ruby limiter

* Make request limit as enum

* convert limit to seconds

* add rate limiter
arp99 pushed a commit to arp99/multiwoven that referenced this issue May 3, 2024
@sumitd94
Merge pull request Multiwoven#74 from Multiwoven/docs/readme
865003b 
docs: update readme for multiwoven ui
arp99 pushed a commit to arp99/multiwoven that referenced this issue May 3, 2024
@karthik-sivadas
feat: Implement static, variable and template catalog field mapping (M…
ed1d046 
…ultiwoven#74)

* feat: Add configuration action in sync controller

* feat: Add standard, static and template mapping to UserMapping

* Refactor the UserMapping

* Update sync configuration for template variable current_timestamp

* Fix failing test case due to stream name validation

* Include custom filters and update UserMapping Test

* Add test for custom_filters lib module

* fix: Fixes based on review changes

* Update field name from value and template to
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@afthabvp