Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Polars engine CPU fallback for GPU out-of-memory errors #16835

Open
beckernick opened this issue Sep 19, 2024 · 0 comments
Open

[FEA] Polars engine CPU fallback for GPU out-of-memory errors #16835

beckernick opened this issue Sep 19, 2024 · 0 comments
Labels
cudf.polars Issues specific to cudf.polars feature request New feature or request

Comments

@beckernick
Copy link
Member

Today, users of the Polars GPU engine don't experience graceful performance degradation for GPU out-of-memory errors like users of cuDF pandas do -- instead, the query will fail. This is a pain point that's come up consistently in feedback from early users.

In parallel to investigating UVM, we should also investigate the feasibility of the current inspector-executor design supporting different types of CPU fallback when the GPU engine hits an out-of-memory error. E.g., we could rewind and execute the full query from scratch with the CPU engine or we could rewind only a portion of the query (which might require subgraph based hybrid execution).

@beckernick beckernick added cudf.polars Issues specific to cudf.polars feature request New feature or request labels Sep 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cudf.polars Issues specific to cudf.polars feature request New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant