You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
PFIO supports various container file formats to aggregate many small files into single large file with metadata mapping, e.g. HDF5, ZIP and Tar (and more in future)
but does PFIO currently support tar files at the moment or plan to add its support in the future?
When I quickly try it as follows, pfio did not recognize a tar file:
withpfio.v2.from_url('file:///absolute_path/to/tar_file.tar') asf:
# raises ValueError: /absolute_path/to/tar_file.tar must be a directory
...
The text was updated successfully, but these errors were encountered:
I have been hesitating to support tar so far, because the format of tar needs seeking every head of the file entry to create directory tree map inside the tarball. The expected implementation of tar container will be very inefficient at the very beginning of opening the tarball as a PFIO container. Supporting tar format aiming for small tarballs for utility won't be bad, but it's in lower priority for us. Absolutely, contribution will be welcomed.
See also: https://superuser.com/a/538798
Hi, the document says
but does PFIO currently support tar files at the moment or plan to add its support in the future?
When I quickly try it as follows, pfio did not recognize a tar file:
The text was updated successfully, but these errors were encountered: