Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Docker memory keep increasing in "serve" mode #20

Open
sythello opened this issue Nov 1, 2021 · 4 comments
Open

Docker memory keep increasing in "serve" mode #20

sythello opened this issue Nov 1, 2021 · 4 comments
Labels
bug Something isn't working

Comments

@sythello
Copy link

sythello commented Nov 1, 2021

Hello! I was trying to use your model to parse a reasonably large amount of text into SQL (similar size as Spider). I used the "serve" mode. I allowed 8GB for docker container with 2GB swap. At the beginning everything was running fine, but as more and more text gets parsed, the memory usage of the docker container gets larger and larger, and finally exited with Error 137 (OOM).

What should we do to fix or avoid this issue? Any advice is appreciated. Thank you!

@tscholak
Copy link
Collaborator

tscholak commented Nov 1, 2021

Hi @sythello,
Thanks for trying out our code! I'm sorry to hear that you have issues with memory consumption. I have not run into that issue myself, but I'm also working with much higher constraints: I usually use 32 GB when I run this code.
Can you say which process in the container is responsible for the issue?
Torsten

@sythello
Copy link
Author

sythello commented Nov 1, 2021

Hi Torsten,
Thanks for the prompt reply! I just checked the container. The relevant processes in the container I can see are "python" and "picard"; "python" is the one with increasing memory usage. Not sure whether this is helpful...

@tscholak
Copy link
Collaborator

tscholak commented Nov 9, 2021

Hi @sythello, It is helpful, thanks! Unfortunately, at this time, I don't have a solution for you. The easiest "fix" would be to give the docker daemon more memory.

@tscholak tscholak added the bug Something isn't working label Nov 16, 2021
@ReinierKoops
Copy link

Just to let you know I have the same issue with same setup.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants