DPDK: Fix source for tarball #3505
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Fixing one bug uncovered a few others. Fixes the way the Tar tool handles fetching the filename of the tar file it downloads.
squirrelsc
reviewed
Nov 11, 2024
|
Note: testing in progress. |
mcgov
force-pushed
the
mcgov/source_fix
branch
from
2bed636 to
a0638eb
Compare
squirrelsc
reviewed
Nov 12, 2024
squirrelsc
reviewed
Nov 12, 2024
squirrelsc
reviewed
Nov 12, 2024
mcgov
force-pushed
the
mcgov/source_fix
branch
from
a0638eb to
699f611
Compare
When running Wget.get(..., force_run=False) and Tar.extract it is useful to allow Tar to skip extracting existing files on the second pass. Allow the skip-old-files option, so Tar.extract will not overwrite existing files in the output directory. Note: it's important to not use this option if you are providing LISA with a default filename for your tarballs. This option could silently allow Tar.extract to not update the contents of a directory with the newer file contents. I don't see anyone using that schema now. My apologies to future devs who find this commit message while debugging that issue. Tar: chi comments
Dpdk: chi comments
mcgov
force-pushed
the
mcgov/source_fix
branch
from
699f611 to
57fd240
Compare
squirrelsc
reviewed
Nov 23, 2024
|
@LiliDeng LGTM |
LiliDeng
approved these changes
Dec 4, 2024
mcgov
added a commit
that referenced
this pull request
Dec 4, 2024
* urlparse tar fix Fixing one bug uncovered a few others. Fixes the way the Tar tool handles fetching the filename of the tar file it downloads. * Wget: add caching * Tar: Allow skip-old-files option When running Wget.get(..., force_run=False) and Tar.extract it is useful to allow Tar to skip extracting existing files on the second pass. Allow the skip-old-files option, so Tar.extract will not overwrite existing files in the output directory. Note: it's important to not use this option if you are providing LISA with a default filename for your tarballs. This option could silently allow Tar.extract to not update the contents of a directory with the newer file contents. I don't see anyone using that schema now. My apologies to future devs who find this commit message while debugging that issue. Tar: chi comments * TarDownloader: enable skip_old_files option in tar extract Dpdk: chi comments * Tar: fix subclass prototype * Wget: remove unneeded return
mcgov
added a commit
that referenced
this pull request
Dec 5, 2024
* urlparse tar fix Fixing one bug uncovered a few others. Fixes the way the Tar tool handles fetching the filename of the tar file it downloads. * Wget: add caching * Tar: Allow skip-old-files option When running Wget.get(..., force_run=False) and Tar.extract it is useful to allow Tar to skip extracting existing files on the second pass. Allow the skip-old-files option, so Tar.extract will not overwrite existing files in the output directory. Note: it's important to not use this option if you are providing LISA with a default filename for your tarballs. This option could silently allow Tar.extract to not update the contents of a directory with the newer file contents. I don't see anyone using that schema now. My apologies to future devs who find this commit message while debugging that issue. Tar: chi comments * TarDownloader: enable skip_old_files option in tar extract Dpdk: chi comments * Tar: fix subclass prototype * Wget: remove unneeded return
adityagesh
pushed a commit
that referenced
this pull request
Dec 20, 2024
* urlparse tar fix Fixing one bug uncovered a few others. Fixes the way the Tar tool handles fetching the filename of the tar file it downloads. * Wget: add caching * Tar: Allow skip-old-files option When running Wget.get(..., force_run=False) and Tar.extract it is useful to allow Tar to skip extracting existing files on the second pass. Allow the skip-old-files option, so Tar.extract will not overwrite existing files in the output directory. Note: it's important to not use this option if you are providing LISA with a default filename for your tarballs. This option could silently allow Tar.extract to not update the contents of a directory with the newer file contents. I don't see anyone using that schema now. My apologies to future devs who find this commit message while debugging that issue. Tar: chi comments * TarDownloader: enable skip_old_files option in tar extract Dpdk: chi comments * Tar: fix subclass prototype * Wget: remove unneeded return
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fix the way the TarDownloader handles dowloading files and identifying their filenames. This required fixing a bug in the Tar tool where Linux would not infer the filename in the default case like the Windows version does. Previously, providing a directory and not a filename would result in the tool identifying an entire directory of files as the filename when the Wget tool fetches a cached result.
This PR fixes that issue by allowing the tool to infer the filename, this fixes the ability to use the Wget tool without force_run when using a default filename.