Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: implement datafusion API using ParquetExec #35

Merged
merged 4 commits into from
Jul 4, 2024

Conversation

xushiyan
Copy link
Member

@xushiyan xushiyan commented Jul 3, 2024

  • upgrade arrow from 50 to 52.0.0
  • upgrade datafusion 35 to 39.0.0
  • leverage ParquetExec for implementing TableProvider for Hudi in datafusion
  • add hoodie.read.input.partitions config

@xushiyan xushiyan added this to the release-0.1.0 milestone Jul 3, 2024
Copy link

codecov bot commented Jul 3, 2024

Codecov Report

Attention: Patch coverage is 89.70588% with 7 lines in your changes missing coverage. Please review.

Project coverage is 86.66%. Comparing base (52a9245) to head (9589174).

Files Patch % Lines
crates/datafusion/src/lib.rs 77.77% 6 Missing ⚠️
crates/core/src/config/mod.rs 95.65% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main      #35      +/-   ##
==========================================
- Coverage   88.84%   86.66%   -2.18%     
==========================================
  Files          10       11       +1     
  Lines         511      540      +29     
==========================================
+ Hits          454      468      +14     
- Misses         57       72      +15     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@xushiyan xushiyan changed the title refactor: implement datafusion API using ParquetExec feat: implement datafusion API using ParquetExec Jul 4, 2024
@xushiyan xushiyan merged commit e8fde26 into apache:main Jul 4, 2024
5 of 6 checks passed
@xushiyan xushiyan deleted the upgrade-datafusion branch July 4, 2024 04:59
@xushiyan xushiyan mentioned this pull request Jul 12, 2024
15 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant