feat: Notebooks to support multiple hudi versions#18255
Open
rangareddy wants to merge 8 commits intoapache:masterfrom
Open
feat: Notebooks to support multiple hudi versions#18255rangareddy wants to merge 8 commits intoapache:masterfrom
rangareddy wants to merge 8 commits intoapache:masterfrom
Conversation
…/github.com/rangareddy/hudi into notebooks_to_support_multiple_hudi_versions
danny0405
approved these changes
Feb 27, 2026
Contributor
|
Let's fix the compile errors: Error: ere 2 source files that did not have Apache License [ERROR]
./hudi-notebooks/notebooks/06_hudi_trino_example.ipynb
./hudi-notebooks/notebooks/07_hudi_presto_example.ipynb
Error: Process completed with exit code 1. |
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## master #18255 +/- ##
==========================================
Coverage 57.29% 57.30%
- Complexity 18560 18579 +19
==========================================
Files 1945 1947 +2
Lines 106256 106396 +140
Branches 13131 13153 +22
==========================================
+ Hits 60880 60967 +87
- Misses 39654 39680 +26
- Partials 5722 5749 +27
Flags with carried forward coverage won't be shown. Click here to find out more. 🚀 New features to boost your workflow:
|
Collaborator
Collaborator
Author
|
Hi @danny0405 Now Al checks are passed. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Describe the issue this Pull Request addresses
Currently, the Hudi Docker environment is locked into a single version of Hudi and Spark, limiting developers' ability to test cross-version compatibility. Additionally, there is a lack of out-of-the-box support for querying Hudi tables via Trino and Presto within the notebook environment.
This PR addresses these gaps by:
Summary and Changelog
This PR enhances the local development environment by making the Hudi version dynamic and expanding the analytics toolset available to users.
Impact
Users can now build and run Hudi notebooks for specific versions by passing build arguments. The inclusion of Trino/Presto clients allows for immediate end-to-end testing of the "Lakehouse" architecture (Write via Spark, Read via Trino/Presto) in a single container.
Risk Level
Low. These changes primarily affect the local development/Docker environment and do not alter the core Hudi library code or public Java APIs.
Documentation Update
Contributor's checklist