Skip to content

Conversation

@dain
Copy link
Member

@dain dain commented Jan 3, 2026

Description

This PR adds comprehensive support for Iceberg v3 row lineage, enabling Trino to read and preserve row identity metadata ($row_id and $last_updated_sequence_number).

Changes include:

  • Reading lineage columns: Expose $row_id and $last_updated_sequence_number as queryable columns for v3 tables
  • OPTIMIZE is now enabled for v3 tables and preserves lineage data
  • UPDATE and MERGE operations preserve the original $row_id for modified rows, maintaining row identity across updates
  • Enable cleanup procedures (expire_snapshots, remove_orphan_files) on v3 tables
  • Run Iceberg connector tests against both v2 and v3 format versions

Release notes

(X) Release notes are required, with the following suggested text:

## Iceberg
* Add support for Iceberg v3 row lineage, including reading `$row_id` and `$last_updated_sequence_number` columns, preserving row identity during UPDATE/MERGE operations, and OPTIMIZE support. ({issue}`issuenumber)

dain added 3 commits January 2, 2026 14:26
All usage of any unimplemented v3 feature results in a failure.
Column name and variable were not updated to be merge specific when the
merge PR was being reviewed.
@cla-bot cla-bot bot added the cla-signed label Jan 3, 2026
@github-actions github-actions bot added iceberg Iceberg connector lakehouse labels Jan 3, 2026
@dain dain marked this pull request as ready for review January 3, 2026 07:17
@chenjian2664
Copy link
Contributor

chenjian2664 commented Jan 6, 2026

Is the second commit "add support for Iceberg v3 deletion vectors" added intentionally?

@dain
Copy link
Member Author

dain commented Jan 9, 2026

Is the second commit "add support for Iceberg v3 deletion vectors" added intentionally?

Yep. The first two commits are the base from another PR. Row lineage needs deletions to work to fully test that rowid works for update commands.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Development

Successfully merging this pull request may close these issues.

2 participants