-
Notifications
You must be signed in to change notification settings - Fork 139
feat: Implement UCCommitter::publish
#1626
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
feat: Implement UCCommitter::publish
#1626
Conversation
UCCommitter::publish
Codecov Report❌ Patch coverage is Additional details and impacted files@@ Coverage Diff @@
## main #1626 +/- ##
==========================================
+ Coverage 84.16% 84.22% +0.06%
==========================================
Files 123 124 +1
Lines 34148 34364 +216
Branches 34148 34364 +216
==========================================
+ Hits 28739 28943 +204
- Misses 4020 4031 +11
- Partials 1389 1390 +1 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
86c6764 to
4675bbc
Compare
4675bbc to
3dd3444
Compare
22da31d to
97ea4d6
Compare
Add new types and methods to support publishing catalog commits to the Delta log: - CatalogCommit: Represents a ratified catalog commit that needs to be published - PublishMetadata: Bundles the information needed for publishing (snapshot version and list of catalog commits to publish) - PublishResult: Enum indicating success or not-applicable for non-catalog committers - Committer::is_catalog_committer(): Returns whether this is a catalog committer - Committer::publish(): Publishes catalog commits to the Delta log Update FileSystemCommitter and UCCommitter to implement the new trait methods. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
97ea4d6 to
c58781b
Compare
c58781b to
c910126
Compare
nicklan
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm!
DrakeLin
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm
🥞 Stacked PR
Use this link to review incremental changes.
What changes are proposed in this pull request?
This PR implements the
UCCommitter::publishAPI. It's pretty simple. We us the Engine StorageHandler trait to atomically copy files from staged location published location.How was this change tested?
New UT.