Problem with zarr metadata when using zarr memory store

[joaobuibergen]

Hi,

I've reluctantly moved to the new version of parcels with zarr output and have been plowing through a series of errors related to the zarr format. The most recent is the following, related to some missing zmetadata dictionary key. I've looked around and it seems it is related to unconsolidated metadata. What should I do?

Can anyone help me with this?

compute FSLE for 2005-01-01 12:00:00
at 0 days, 0 hours, 0 minutes, 0 seconds.
INFO: Compiled ArrayJITParticleAdvectionRK4 ==> /tmp/parcels-153555/lib758736f00c74a81306858c5e1c8c8281_0.so
INFO: Output files are stored in <zarr.storage.MemoryStore object at 0x7f4e63848d90>.zarr.
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████| 15552000.0/15552000.0 [03:08<00:00, 82650.43it/s]
Traceback (most recent call last):
File "/home/johor1356/.conda/envs/py3_parcels/lib/python3.9/site-packages/zarr/storage.py", line 826, in getitem
value = parent[key]
KeyError: '.zmetadata'

[erikvansebille]

Thank you for reporting @joaobuibergen, I'd be happy to look into this. But in order to help you, we need (much) more information. What is the code you ran that created this error?

[joaobuibergen]

Hi Erik, I've made further debugging. The error seems to occur randomly, so I'm suspecting it could be a hardware issue. I'll try to verify this before pursuing this further. João Bettencourt SEAS Fellow Geophysical Institute - University of Bergen Bjerknes Centre for Climate Research https://www.uib.no/en/persons/João.Bettencourt

…

On Tue, Nov 7, 2023 at 7:27 AM Erik van Sebille ***@***.***> wrote: Thank you for reporting @joaobuibergen <https://github.com/joaobuibergen>, I'd be happy to look into this. But in order to help you, we need (much) more information. What is the code you ran that created this error? — Reply to this email directly, view it on GitHub <#1460 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/A4G336E4WPSVNSXN4NY3KRLYDHIERAVCNFSM6AAAAAA7AE4EZ2VHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM3TIOJVGE4DA> . You are receiving this because you were mentioned.Message ID: ***@***.***>