Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] SynchronizeDeltaToSnowflakeTask uses RunQuery instead of SnowflakeRunQueryPython in _merge_staging #120

Open
mikita-sakalouski opened this issue Nov 24, 2024 · 0 comments
Open

[BUG] SynchronizeDeltaToSnowflakeTask uses RunQuery instead of SnowflakeRunQueryPython in _merge_staging #120

mikita-sakalouski opened this issue Nov 24, 2024 · 0 comments
Assignees
@mikita-sakalouski
Labels
bug Something isn't working
Milestone
0.9.0

Comments

@mikita-sakalouski
Copy link
Contributor

Describe the bug

SynchronizeDeltaToSnowflakeTask uses RunQuery instead of SnowflakeRunQueryPython in _merge_staging which leads to errors in Spark Connect sessions.

Steps to Reproduce

  1. Initialize SynchronizeDeltaToSnowflakeTask
  2. Run execute
  3. See error
RuntimeError: Your Spark session does not have a JVM and cannot run Snowflake query using RunQuery implementation. Please update your code to use python connector for Snowflake.

Expected behavior

Switch to SnowflakeRunQueryPython

Environment

Spark Connect
@mikita-sakalouski mikita-sakalouski added the bug Something isn't working label Nov 24, 2024
@mikita-sakalouski mikita-sakalouski added this to the 0.9.0 milestone Nov 24, 2024
@mikita-sakalouski mikita-sakalouski self-assigned this Nov 24, 2024
@mikita-sakalouski mikita-sakalouski changed the title [BUG] SynchronizeDeltaToSnowflakeTask uses RubQuery instead of SnowflakeRunQueryPython in _merge_staging [BUG] SynchronizeDeltaToSnowflakeTask uses RunQuery instead of SnowflakeRunQueryPython in _merge_staging Nov 24, 2024
@mikita-sakalouski mikita-sakalouski mentioned this issue Nov 24, 2024
Open
9 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mikita-sakalouski mikita-sakalouski

Labels
bug Something isn't working
Projects
Koheesio
Status: No status
Milestone
0.9.0
Development

When branches are created from issues, their pull requests are automatically linked.

120-bug-synchronizedeltatosnowflaketask-uses-runquery-instead-of-snowflakerunquerypython-in-_merge_staging Nike-Inc/koheesio
1 participant
@mikita-sakalouski