resources of SWP don't be released

[zerojuzi]

I notice resources of SWP don't be released after simpledet training, especially on large data sets training, resources of SWP are full, I must be used swapoff -a and swapon -a to solve the problem. I want to which is bug of mxnet or simpledet? and may you help me solve the problem, thank you very much.

[RogerChern]

I think it is neither the problem of MXNet nor SimpleDet. The swap is managed by the kernel and should not be used during normal training. If you find yourself running low of free memory, you can reduce the number of loader_worker by adding loader_workder = 1 under the General config class.

[zerojuzi]

I used 'free -g' notice buff/cache progressively increase during training when I adding loader_workder = 1 , and free progressively reduce，finally it become 0, so SWP resources begin to be used. I want to know what information is kept in the cache, and can I clear this information. thank you very much. @RogerChern

[RogerChern]

You can free it up freely. Just batches of data.

…

On Thu, Jan 2, 2020 at 2:28 PM zhangxue123 ***@***.***> wrote: I used 'free -g' notice buff/cache progressively increase during training when I adding loader_workder = 1 , and free progressively reduce，finally it become 0, so SWP resources begin to be used. I want to know what information is kept in the cache, and can I clear this information. thank you very much. @RogerChern <https://github.com/RogerChern> — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#284>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABGODH2NTYUQALFARZ3CGS3Q3WCRDANCNFSM4J7IOR7Q> .