Skip to content

Conversation

@scottsand-db
Copy link
Collaborator

@scottsand-db scottsand-db commented Jan 17, 2026

🥞 Stacked PR

Use this link to review incremental changes.


What changes are proposed in this pull request?

This PR implements the UCCommitter::publish API. It's pretty simple. We us the Engine StorageHandler trait to atomically copy files from staged location published location.

How was this change tested?

New UT.

@scottsand-db scottsand-db changed the title add uc-committer publish impl feat: Implement UCCommitter::publish Jan 17, 2026
@codecov
Copy link

codecov bot commented Jan 17, 2026

Codecov Report

❌ Patch coverage is 91.78082% with 18 lines in your changes missing coverage. Please review.
✅ Project coverage is 84.22%. Comparing base (eb3d36c) to head (c910126).

Files with missing lines Patch % Lines
uc-catalog/src/committer.rs 87.14% 9 Missing ⚠️
kernel/src/committer/filesystem.rs 33.33% 8 Missing ⚠️
kernel/src/committer/publish_types.rs 99.24% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1626      +/-   ##
==========================================
+ Coverage   84.16%   84.22%   +0.06%     
==========================================
  Files         123      124       +1     
  Lines       34148    34364     +216     
  Branches    34148    34364     +216     
==========================================
+ Hits        28739    28943     +204     
- Misses       4020     4031      +11     
- Partials     1389     1390       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@scottsand-db scottsand-db force-pushed the stack/committer_publish_3 branch from 86c6764 to 4675bbc Compare January 19, 2026 20:07
@scottsand-db scottsand-db force-pushed the stack/committer_publish_3 branch from 4675bbc to 3dd3444 Compare January 20, 2026 16:58
@scottsand-db scottsand-db marked this pull request as ready for review January 20, 2026 17:04
@scottsand-db scottsand-db force-pushed the stack/committer_publish_3 branch 2 times, most recently from 22da31d to 97ea4d6 Compare January 21, 2026 17:03
scottsand-db and others added 8 commits January 21, 2026 17:04
Add new types and methods to support publishing catalog commits to the Delta log:

- CatalogCommit: Represents a ratified catalog commit that needs to be published
- PublishMetadata: Bundles the information needed for publishing (snapshot version
  and list of catalog commits to publish)
- PublishResult: Enum indicating success or not-applicable for non-catalog committers
- Committer::is_catalog_committer(): Returns whether this is a catalog committer
- Committer::publish(): Publishes catalog commits to the Delta log

Update FileSystemCommitter and UCCommitter to implement the new trait methods.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@scottsand-db scottsand-db force-pushed the stack/committer_publish_3 branch from 97ea4d6 to c58781b Compare January 21, 2026 17:04
@scottsand-db scottsand-db force-pushed the stack/committer_publish_3 branch from c58781b to c910126 Compare January 21, 2026 17:18
@scottsand-db scottsand-db requested review from OussamaSaoudi and removed request for OussamaSaoudi January 21, 2026 17:19
@github-actions github-actions bot added the breaking-change Change that require a major version bump label Jan 21, 2026
Copy link
Member

@nicklan nicklan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm!

@nicklan nicklan requested a review from OussamaSaoudi January 22, 2026 20:33
Copy link
Collaborator

@DrakeLin DrakeLin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

breaking-change Change that require a major version bump

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants