Getting 403 while fetching logs from UI.

[areyohrahul]

Hi, I'm getting a 403 error while fetching logs from the airflow UI. (Airflow : 2.5.1)

I've already checked the secret_key in both the web server and the workers. Time is also synchronized. And, correct DNS host entries are also present in my web server machine.

What do you think I should do?

[areyohrahul]

I ran my worker in DEBUG mode to see any errors. Found out that server_logs.py was throwing an error saying "Signature verification failed"

But I don't understand how that could be happening given that my webserver and worker have the same secret_key.

[areyohrahul]

Noticed one more thing, the gunicorn server running to serve the logs has been running for a long time. Do I explicitly need to reload it?

Currently, to restart a worker, I just kill the PID and then run "airflow celery worker" command

[areyohrahul]

Resolved! The issue was caused by the Gunicorn server failing to reload upon restarting the Airflow worker.

I manually killed the Gunicron master and then restarted the airflow worker.