Skip to content

feat: materialize uuids as binary(16) in to_pyarrow() #11581

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

feat: materialize uuids as binary(16) in to_pyarrow() #11581

wants to merge 2 commits into from

Conversation

NickCrews
Copy link
Contributor

@NickCrews NickCrews commented Aug 26, 2025 •
edited
Loading

Attempt at fixes #8532

I'm curious if this breaks on a lot of the cloud backends. I didn't start touching them yet, I want to see what CI does.

  • implement the UUIDValue -> BinaryValue casting for each backend in the compiler's visit_Cast(). Then the user could do this casting themselves as well. We then just piggyback on this implementation in the .to_pyarrow() call. I have done this in duckdb ( and halfway in datafusion) but need to migrate postgres and sqlite to this approach
  • Fix all the other backends that are inevitably going to fail.

@github-actions github-actions bot added tests Issues or PRs related to tests postgres The PostgreSQL backend sqlite The SQLite backend datafusion The Apache DataFusion backend duckdb The DuckDB backend sql Backends that generate SQL labels Aug 26, 2025
@NickCrews
Copy link
Contributor Author

@cpcloud before I keep working on this, can you verify that this seems like the right direction?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
datafusion The Apache DataFusion backend duckdb The DuckDB backend postgres The PostgreSQL backend sql Backends that generate SQL sqlite The SQLite backend tests Issues or PRs related to tests
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

bug: arrow type error when show data with 'UUID' object
1 participant
@NickCrews