Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test failure: test_delete_ws_groups_should_delete_renamed_and_reflected_groups_only #3396

Open
github-actions bot opened this issue Nov 30, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@github-actions
Copy link

❌ test_delete_ws_groups_should_delete_renamed_and_reflected_groups_only: TimeoutError: Timed out after 0:05:00 (5m20.413s)
TimeoutError: Timed out after 0:05:00
[gw9] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_suzwk.groups] fetching groups inventory
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 633, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_suzwk`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_suzwk.groups] crawling new set of snapshot data for groups
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_suzwk.groups] found 1 new records for groups
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration...
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx_GI32j-ra78a5836f (id=470771310784840) -> ucx-temp-ucx_GI32j-ra78a5836f
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx_GI32j-ra78a5836f (id=470771310784840) -> ucx-temp-ucx_GI32j-ra78a5836f
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_GI32j-ra78a5836f (id=470771310784840) -> ucx-temp-ucx_GI32j-ra78a5836f
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_GI32j-ra78a5836f (id=470771310784840) -> ucx-temp-ucx_GI32j-ra78a5836f
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx_GI32j-ra78a5836f (id=470771310784840) -> ucx-temp-ucx_GI32j-ra78a5836f
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 470771310784840 (renamed to ucx-temp-ucx_GI32j-ra78a5836f)
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 470771310784840 (renamed to ucx-temp-ucx_GI32j-ra78a5836f)
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete.
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_suzwk.groups] fetching groups inventory
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration...
05:24 ERROR [databricks.labs.ucx.workspace_access.groups] Skipping ucx_GI32j-ra78a5836f: group already exists in workspace
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 60 Group
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_suzwk.groups] fetching groups inventory
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Starting to remove 1 migrated workspace groups...
05:24 WARNING [databricks.labs.ucx.workspace_access.groups] Not deleting group ucx-temp-ucx_GI32j-ra78a5836f(id=470771310784840) (originally ucx_GI32j-ra78a5836f): its migrated account group (ucx_GI32j-ra78a5836f) cannot be found.
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 65 WorkspaceGroup
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration does not contain any of the 0 deleted workspace groups; possibly deleted.
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 65 WorkspaceGroup
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration does not contain any of the 0 deleted workspace groups; possibly deleted.
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration omitted all 0 workspace groups; assuming deleted.
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_suzwk.groups] fetching groups inventory
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 633, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_suzwk`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_suzwk.groups] crawling new set of snapshot data for groups
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_suzwk.groups] found 1 new records for groups
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration...
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx_GI32j-ra78a5836f (id=470771310784840) -> ucx-temp-ucx_GI32j-ra78a5836f
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx_GI32j-ra78a5836f (id=470771310784840) -> ucx-temp-ucx_GI32j-ra78a5836f
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_GI32j-ra78a5836f (id=470771310784840) -> ucx-temp-ucx_GI32j-ra78a5836f
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_GI32j-ra78a5836f (id=470771310784840) -> ucx-temp-ucx_GI32j-ra78a5836f
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx_GI32j-ra78a5836f (id=470771310784840) -> ucx-temp-ucx_GI32j-ra78a5836f
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 470771310784840 (renamed to ucx-temp-ucx_GI32j-ra78a5836f)
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 470771310784840 (renamed to ucx-temp-ucx_GI32j-ra78a5836f)
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete.
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_suzwk.groups] fetching groups inventory
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration...
05:24 ERROR [databricks.labs.ucx.workspace_access.groups] Skipping ucx_GI32j-ra78a5836f: group already exists in workspace
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 60 Group
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_suzwk.groups] fetching groups inventory
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Starting to remove 1 migrated workspace groups...
05:24 WARNING [databricks.labs.ucx.workspace_access.groups] Not deleting group ucx-temp-ucx_GI32j-ra78a5836f(id=470771310784840) (originally ucx_GI32j-ra78a5836f): its migrated account group (ucx_GI32j-ra78a5836f) cannot be found.
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 65 WorkspaceGroup
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration does not contain any of the 0 deleted workspace groups; possibly deleted.
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
05:24 INFO [databricks.labs.ucx.workspace_access.groups] Found 65 WorkspaceGroup
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration does not contain any of the 0 deleted workspace groups; possibly deleted.
05:24 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration omitted all 0 workspace groups; assuming deleted.
[gw9] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #291

@github-actions github-actions bot added the bug Something isn't working label Nov 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

0 participants