New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Why does huge BIOM file use 128G of memory? #9

Open

steve-fischer-200 opened this issue May 2, 2024 · 0 comments

Assignees

Collaborator

steve-fischer-200 commented May 2, 2024 •

edited

Loading

A particular BIOM file ("Huey the Huge") breaks the biom loader by consuming all(?) available memory, up to 128G before timing out.

Why???

The concern is that this could strike again with a new BIOM file, and risk bringing down the plugin server with OOM.

The process involved was:
/usr/bin/perl /opt/veupathdb/gus_home/bin/ga ApiCommonData::Load::Plugin::MBioInsertEntityGraph

The biom file is available at
`palm: /home/sfischer/vdi-april-26/AHDnYkkRixM/

steve-fischer-200 assigned jbrestel

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment