Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

s3() destination high memory usage caused by reload #317

Open
alltilla opened this issue Sep 30, 2024 · 0 comments
Open

s3() destination high memory usage caused by reload #317

alltilla opened this issue Sep 30, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@alltilla
Copy link
Member

AxoSyslog

Version of AxoSyslog

4.8.1

Issue

Failure

The memory usage of the syslog-ng process increases with every syslog-ng-ctl reload indefinitely.
It seems like that this is not a memory leak, but the botocore python library is caching some session related data.

The following python snippet also reproduces something similar, but the memory usage stops after 5-10 "reloads":

from boto3 import Session, client

while True:
    input(": ")

    # This does not "leak"
    # c = client("s3")
    # c.close()

    s = Session()
    c = s.client("s3")
    c.close()

The caching happens around the Session object, if we create the client directly, the memory usage problem does not happen.

This might be related: boto/boto3#3614

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant