Skip to content

(WIP) chore(ci): Add test jobs and Codecov integration in GitHub Actions#18225

Draft
yihua wants to merge 3 commits intoapache:masterfrom
yihua:chore-gh-ci
Draft

(WIP) chore(ci): Add test jobs and Codecov integration in GitHub Actions#18225
yihua wants to merge 3 commits intoapache:masterfrom
yihua:chore-gh-ci

Conversation

@yihua
Copy link
Contributor

@yihua yihua commented Feb 19, 2026

Describe the issue this Pull Request addresses

GitHub Actions (bot.yml) skips several test suites for Spark 3.5 + Scala 2.12, deferring them to Azure CI. Three Azure jobs have no GitHub Actions equivalent:

  • UT_FT_1 (hudi-hadoop-common & hudi-spark-client)
  • UT_FT_7 (hudi-utilities)
  • UT_FT_10 (common & other modules).

This PR aims to ensure GitHub Actions has full test coverage so we can migrate away from Azure CI.

Summary and Changelog

Add 3 missing test jobs to GitHub Actions and integrate Codecov for code coverage reporting.

  • Add test-spark-client-and-hadoop-common job (Azure UT_FT_1): hudi-hadoop-common UT, hudi-spark-client UT & FT
  • Add test-utilities job (Azure UT_FT_7): hudi-utilities UT (TestHoodie*) & FT
  • Add test-common-and-other-modules job (Azure UT_FT_10): remaining modules UT & FT using exclusion lists from Azure config
  • All new jobs run on Spark 3.5 / Scala 2.12 / Flink 1.18 / JDK 11 to match Azure CI
  • Enable JaCoCo in jobs via -Djacoco.skip=false and upload coverage with codecov/codecov-action@v5

Impact

CI-only change that adds test jobs and enables coverage reporting.

Risk Level

none

Documentation Update

none

Contributor's checklist

  • Read through contributor's guide
  • Enough context is provided in the sections above
  • Adequate tests were added if applicable

@github-actions github-actions bot added size:M PR with lines of changes in (100, 300] size:L PR with lines of changes in (300, 1000] and removed size:M PR with lines of changes in (100, 300] labels Feb 19, 2026
@yihua yihua force-pushed the chore-gh-ci branch 2 times, most recently from b47e09e to 6276f23 Compare February 21, 2026 04:03
@github-actions github-actions bot added size:M PR with lines of changes in (100, 300] and removed size:L PR with lines of changes in (300, 1000] labels Feb 21, 2026
@codecov-commenter
Copy link

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 69.23%. Comparing base (057af9e) to head (02b210b).

Additional details and impacted files
@@              Coverage Diff              @@
##             master   #18225       +/-   ##
=============================================
+ Coverage     57.28%   69.23%   +11.94%     
- Complexity    18532    26832     +8300     
=============================================
  Files          1944     2369      +425     
  Lines        106126   127787    +21661     
  Branches      13118    15135     +2017     
=============================================
+ Hits          60793    88471    +27678     
+ Misses        39610    32569     -7041     
- Partials       5723     6747     +1024     
Flag Coverage Δ
common-and-other-modules 44.16% <ø> (?)
hadoop-mr-java-client 45.42% <ø> (+<0.01%) ⬆️
spark-client-hadoop-common 48.37% <ø> (?)
spark-java-tests 47.42% <ø> (-0.01%) ⬇️
spark-scala-tests 45.50% <ø> (-0.01%) ⬇️
utilities 38.83% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.
see 1200 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:M PR with lines of changes in (100, 300]

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants