Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improving monitoring of cache misses #1621

Open
bbockelm opened this issue Oct 7, 2024 · 0 comments
Open

Improving monitoring of cache misses #1621

bbockelm opened this issue Oct 7, 2024 · 0 comments
Labels
cache Issue relating to the cache component director Issue relating to the director component enhancement New feature or request
Milestone

Comments

@bbockelm
Copy link
Collaborator

bbockelm commented Oct 7, 2024

The monitoring loop on the cache currently writes files into the cache then checks to ensure it can read them out via XRootD, effectively testing out the "cache hit" use case.

Fabio reports that there are use cases where the caches fail but only for "cache misses". Hence, we need to extend the monitoring to work on this case as well.

Here's the general concept I had in mind:

  1. Add functionality to the director that causes it to export a "fake" part of the namespace, solely for monitoring. No XRootD server involved, just the director redirecting to itself and generating the response on demand. From experience: make the response a few dozen bytes; make the name unique per request and not all in the same "directory"; add a rate limiter to prevent from abuse.
  2. The cache periodically downloads a generated object name from its own XRootD endpoint using a signed token. This will always have a cache miss, go to the director, and the director will internally redirect to itself (serving up the requested object).
@bbockelm bbockelm added the enhancement New feature or request label Oct 7, 2024
@bbockelm bbockelm added this to the v7.12.0 milestone Oct 7, 2024
@bbockelm bbockelm added cache Issue relating to the cache component director Issue relating to the director component labels Oct 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cache Issue relating to the cache component director Issue relating to the director component enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant