Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add BackgroundForMultiProcess #572

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

FeLvi-zzz
Copy link

@FeLvi-zzz FeLvi-zzz commented Jan 25, 2025

background

our production servers process a lot of resque jobs.

Coverband::ResqueWorker#perform reports when the job finished, so CPU utilization of our Redis store for collection coverage data goes too high.

what I did

before sending reports to redis, an resque job saves coverage data to file(this should be on tmpfs).
background collector searches, collects and merges those files, and send to redis periodically.

TODO before opening PR

  • add spec
  • test it in our staging/production env
  • make it opt in

@FeLvi-zzz FeLvi-zzz force-pushed the improve-resque-reporter-performance branch from 7c43907 to f5b8dd8 Compare January 26, 2025 00:26
@danmayer
Copy link
Owner

I guess if this is a problem you have hit I could accept this PR, but make it opt-in so it would be off by default for resque users and can optionally be added when folks need the additional complexity.

@FeLvi-zzz
Copy link
Author

Yes, I guess almost all users don't need this function; it should be opt-in. In fact, we have already installed Coverband in some services, and they're not having any issues. I'm only having trouble with our largest service.
I'll make the modifications before opening the PR!

@danmayer
Copy link
Owner

thanks sounds good just tag me again when ready for a full review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants