how can i use weave in multiprocess function?

[kishao1996]

i used ProcessPoolExecutor to speed up my script, but don't know how to trace main function and multiprocess function together?

i passed call to multiprocess function, but got error

concurrent.futures.process._RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/multiprocessing/queues.py", line 245, in _feed
    obj = _ForkingPickler.dumps(obj)
  File "/usr/local/lib/python3.10/multiprocessing/reduction.py", line 51, in dumps
    cls(buf, protocol).dump(obj)
TypeError: cannot pickle '_thread.RLock' object
"""

[kishao1996]

and weave cli ignored my call which created in another process.

@weave.op
def main():
    with ProcessPoolExecutor(max_workers=3) as executor:
        futures = []
        for i in range(3):
            future = executor.submit(func, i)
            futures.append(future)

        for future in futures:
            future.result()

def func(i):
    call = client.create_call(op=f'op_{i}', inputs={'i': i})
    client.finish_call(call)

main()

[kishao1996]

i need to execute client.finish() before process ends. but why it is unnecessary in main process?