Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Apache Iceberg input connector #77

Open
zxqfd555-pw opened this issue Dec 13, 2024 · 0 comments
Open

Add Apache Iceberg input connector #77

zxqfd555-pw opened this issue Dec 13, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@zxqfd555-pw
Copy link
Contributor

Is your feature request related to a problem? Please describe.
There is a need for Apache Iceberg input and output connectors. They need to work in both, streaming and static modes. In the case of a streaming mode, updates must be applied incrementally, without fully rereading the table.

Describe the solution you'd like
There is a native Rust crate for Iceberg. It can be used for an Iceberg connection.

Describe alternatives you've considered
Currently, Iceberg storage can only be accessed by implementing a custom Python input connector. However, this solution is not stable enough for production.

@zxqfd555-pw zxqfd555-pw added the enhancement New feature or request label Dec 13, 2024
@zxqfd555-pw zxqfd555-pw self-assigned this Dec 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant