Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Imagefolder: UnexpectedError with root cause: "[Errno 13] Permission denied: '/tmp/hf-datasets-cache/medium/datasets/....incomplete'" #3027

Open
severo opened this issue Aug 19, 2024 · 2 comments
Labels
blocked-by-upstream The issue must be fixed in a dependency bug Something isn't working P1 Not as needed as P0, but still important/wanted

Comments

@severo
Copy link
Collaborator

severo commented Aug 19, 2024

We have some "UnexpectedError" with this kind of root cause:

https://huggingface.co/datasets/abhi1505/Drone_Data/discussions/9

[Errno 13] Permission denied: '/tmp/hf-datasets-cache/medium/datasets/59146511988270-config-parquet-and-info-abhi1505-Drone_Data-6928f977/downloads/a3d6d38d9159fb9d6429f28224c80ecc7a281b095c77183e4381751ea5f3ae72.incomplete'

https://huggingface.co/datasets/griffinbholt/augmented_waste_classification/discussions/1

[Errno 13] Permission denied: '/tmp/hf-datasets-cache/medium/datasets/26961854788134-config-parquet-and-info-griffinbholt-augmented_wa-56266047/downloads/28fcc0b914dfa1c8da84fbbad2f870ba1dcffb9ca308dab7c4347a9a2a930a5f.incomplete
@severo severo added bug Something isn't working P1 Not as needed as P0, but still important/wanted labels Aug 19, 2024
@severo severo changed the title UnexpectedError with root cause: "[Errno 13] Permission denied: '/tmp/hf-datasets-cache/medium/datasets/....incomplete'" Imagefolder: UnexpectedError with root cause: "[Errno 13] Permission denied: '/tmp/hf-datasets-cache/medium/datasets/....incomplete'" Aug 19, 2024
@severo
Copy link
Collaborator Author

severo commented Aug 19, 2024

cc @polinaeterna maybe

@severo
Copy link
Collaborator Author

severo commented Aug 20, 2024

maybe fixed once we use huggingface_hub's cache in datasets. huggingface/datasets#7105

once upgraded, recompute these errors (UnexpectedError + [Errno 13] Permission denied)

db.cachedResponsesBlue.countDocuments({http_status: 500, error_code: "UnexpectedError", "content.error": { $regex : /^\[Errno 13\] Permission denied/ }, "details.copied_from_artifact": {"$exists": false}})
171

@severo severo added the blocked-by-upstream The issue must be fixed in a dependency label Aug 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
blocked-by-upstream The issue must be fixed in a dependency bug Something isn't working P1 Not as needed as P0, but still important/wanted
Projects
None yet
Development

No branches or pull requests

1 participant