Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support partial restore of only certain objects without reading the entire stream #1

Open
anelson opened this issue Aug 25, 2022 · 0 comments

Comments

@anelson
Copy link
Collaborator

anelson commented Aug 25, 2022

When restoring a tar archive from stdin, it's not possible to seek, and therefore the entire archive must be read even if the user wants to restore only a small subset of objects. However, for file and S3-based archives this isn't the case, and a seekable interface could be presented, so that partial restores can be more efficient.

The challenge to doing this for archives in object storage is that some intelligent buffering is still needed to avoid an excessive amount of GET operations being performed as the tar crate reads bits of metadata here and there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant