You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
AWS supports Hudi in most of their data services, many users leverage AWS SDK for Pandas (formerly AWS DataWrangler) to handle their data.
Since hudi-rs provides Python bindings, we can support reading Hudi tables using the forementioned SDK.
Expected behavior
provide method in AWS SDK for Pandas"
::read_hudi(path, storage_options)
that allows users to read from hudi tables
Additional context
No response
The text was updated successfully, but these errors were encountered:
@kazdy looks like this is more for aws sdk for pands than on hudi-rs. You would need to implement some integration logic on the sdk side and leveraging hudi-rs python api. We can consider proper APIs to add in hudi-rs to support the integration. I'll keep this open to track the integration work.
Description of the improvement
AWS supports Hudi in most of their data services, many users leverage AWS SDK for Pandas (formerly AWS DataWrangler) to handle their data.
Since hudi-rs provides Python bindings, we can support reading Hudi tables using the forementioned SDK.
Expected behavior
provide method in AWS SDK for Pandas"
::read_hudi(path, storage_options)
that allows users to read from hudi tables
Additional context
No response
The text was updated successfully, but these errors were encountered: