Permission Errors When Specifying a Destination Folder in Google Drive Integration (PR #31885)

[svrajesh21]

Apache Airflow version

2.10.4

If "Other Airflow 2 version" selected, which one?

2.10.1

What happened?

When configuring an Airflow task to upload a file to Google Drive with a destination folder specified, the task intermittently fails with a permission error. This issue occurs even when the service account used has appropriate access rights to the target folder.

The error was not observed before the introduction of the destination folder feature in PR #31885.

What you think should happen instead?

The task should upload the file to the specified destination folder without encountering permission errors, provided the service account has the necessary access rights.

How to reproduce

Configure an Airflow task using GoogleDriveToGCSOperator or similar.
Specify a valid destination folder ID for the task.
Ensure the service account used has editor permissions for the destination folder.
Execute the task.
Expected Outcome:
The file should upload successfully to the specified folder.

Actual Outcome:
The task fails with a permission error.

Operating System

Ubuntu 22.04.1 LTS

Versions of Apache Airflow Providers

apache-airflow-providers-google==9.1.0

Deployment

Official Apache Airflow Helm Chart

Deployment details

Helm chart version: 1.7.0
Kubernetes version: v1.26.2
Custom configurations:
Service account with editor permissions for Google Drive.
DAGs mounted via NFS.

Anything else?

Adding detailed logs captured from the Airflow task and Google Drive API might help pinpoint the issue. The error appears to be intermittent, so further investigation into the conditions leading to the failure is necessary.

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[potiuk]

There is lack of details - logs etc. - and then maybe @stiak might help