Help: Memray error when analyzing child process output file

[hithesh-git]

[Name: memray]
[Version: 1.2.0]

I'm encountering an issue while trying to analyze memory usage with Memray for a multi-process python app. While the main process analysis works fine, I'm getting errors when trying to analyze the child process output files 😕

Setup

I'm running Memray on an application (APP1) that generates two child processes from the main process.

Command used to run Memray:

sudo /opt/APP1/bin/python3.9 -m memray run --follow-fork --native --trace-python-allocators -o /etc/app1/output1.bin  -c 'from my_app1 import app; app.main()' -c /etc/app1/app1.conf

Output files generated:

• output1.bin (5.6M)
• output1.bin.26318 (26M)
• output1.bin.26319 (8.1M)

Issue

I can successfully run stats or tree commands on the main output file (output1.bin). For example:

python3.9 -m memray stats /etc/app1/output2.bin

However, when I try to run the same command on the child process output files, I get an error. For instance:

sudo /opt/app1/python3.9/bin/python3.9 -m memray stats /etc/app1/output1.bin.26318

This results in the following error:

Traceback (most recent call last):
  File "/opt/app1/python3.9/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/opt/app1/python3.9/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/opt/app1/lib/python3.9/site-packages/memray/__main__.py", line 6, in <module>
    sys.exit(main())
  File "/opt/app1/lib/python3.9/site-packages/memray/commands/__init__.py", line 124, in main
    arg_values.entrypoint(arg_values, parser)
  File "/opt/app1/lib/python3.9/site-packages/memray/commands/stats.py", line 41, in run
    stats = compute_statistics(
  File "src/memray/_memray.pyx", line 649, in memray._memray.compute_statistics
  File "src/memray/_memray.pyx", line 419, in memray._memray.ProgressIndicator.__enter__
  File "/opt/app1/lib/python3.9/site-packages/rich/progress.py", line 1522, in add_task
    self.refresh()
  File "/opt/app1/lib/python3.9/site-packages/rich/progress.py", line 1433, in refresh
    self.live.refresh()
  File "/opt/app1/lib/python3.9/site-packages/rich/live.py", line 213, in refresh
    self._live_render.set_renderable(self.renderable)
  File "/opt/app1/lib/python3.9/site-packages/rich/live.py", line 195, in renderable
    renderable = self.get_renderable()
  File "/opt/app1/lib/python3.9/site-packages/rich/live.py", line 98, in get_renderable
    self._get_renderable()
  File "/opt/app1/lib/python3.9/site-packages/rich/progress.py", line 1437, in get_renderable
    renderable = Group(*self.get_renderables())
  File "/opt/app1/lib/python3.9/site-packages/rich/progress.py", line 1442, in get_renderables
    table = self.make_tasks_table(self.tasks)
  File "/opt/app1/lib/python3.9/site-packages/rich/progress.py", line 1466, in make_tasks_table
    table.add_row(
  File "/opt/app1/lib/python3.9/site-packages/rich/progress.py", line 1471, in <genexpr>
    else column(task)
  File "/opt/app1/lib/python3.9/site-packages/rich/progress.py", line 518, in __call__
    renderable = self.render(task)
  File "/opt/app1/lib/python3.9/site-packages/rich/progress.py", line 654, in render
    total=max(0, task.total),
TypeError: '>' not supported between instances of 'NoneType' and 'int'

Question

Why am I unable to analyze the child process output files? Could this error be related to the way the child processes are terminating?

Additional Information

• I'm certain there's a memory leak in one of the child threads, but I can't access any reports for verification.
• I've tried exiting the main process using both Ctrl+C and timeout --signal=SIGINT 10s.

Any insights or suggestions on how to properly analyze these child process output files would be greatly appreciated. Thank you in advance for your help!

[godlygeek]

[Version: 1.2.0]

You're testing with a version of Memray that's over 2 years old. We've definitely fixed some bugs in --follow-fork since then. The latest version is Memray 1.14 - does the problem reproduce with a recent version?

The specific error that you're getting appears to have been fixed in Rich version 12.3.0, which was released 2.5 years ago.

[hithesh-git]

Thank you for replying. I figured out a way to use the latest version, and memray works fine :)