Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Robust progress bars #288

Open
gordonwatts opened this issue Jul 14, 2023 · 2 comments
Open

Robust progress bars #288

gordonwatts opened this issue Jul 14, 2023 · 2 comments

Comments

@gordonwatts
Copy link
Collaborator

The polling frequency between transform and minio cause some weird discrepancies

  • Poll serviceX and when the number of files changes there check with minio

We've seen the following cases:

  1. DID finder is complete but the serviceX bar still shows 0/? Only seen with large number of files
  2. ServiceX shows the wrong number as the total files (less than the actual number)

Progress bar must not be red during successful runs

@gordonwatts gordonwatts added this to the 3.0 Release milestone Jul 14, 2023
@kyungeonchoi
Copy link
Contributor

Celery improvements of backend may solve this issue

@ponyisi
Copy link
Collaborator

ponyisi commented Oct 2, 2024

"Progress bar going red for successful transforms" is fixed (actually we have the inverse problem now, the bar for a transform only goes red at the very end when there are failed files, not when the first failed file is detected)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants