Skip to content

Issues: huggingface/accelerate

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

96 Open 1,508 Closed
96 Open 1,508 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Unable to access model gradients with DeepSpeed and Accelerate
#3184 opened Oct 22, 2024 by shouyezhe
2 of 4 tasks
accelerator.prepare() get OOM,but available in single GPU
#3182 opened Oct 21, 2024 by lqf0624
2 of 4 tasks
1
[Bug] The clip_grad_norm of xla fsdp is not right
#3180 opened Oct 21, 2024 by hanwen-sun
4 tasks
Why don't ML engineers use shampoo ?🧴
#3178 opened Oct 18, 2024 by cyber-phys
2
Split_batches argument in Accelerator.__init__ is available, but not used
#3177 opened Oct 17, 2024 by yaraksen
MPI on CPU-only: "no support for _allgather_base"
#3176 opened Oct 17, 2024 by tikhu
2 of 4 tasks
Support --standalone for concurrent single node multi-GPU jobs
#3175 opened Oct 16, 2024 by Olive-Z
Can I load model once or dataset once and copy to subprocess?
#3172 opened Oct 16, 2024 by Hans-digit
1
[Bug] The Transformer Engine plugin seems to be incompatible with LayerNorm that has no weights.
#3171 opened Oct 16, 2024 by IDKiro
2 of 4 tasks
[BUG] Accelerate 1.0.1 failed to train multiple zero-3 models
#3170 opened Oct 15, 2024 by nrailg
2 of 4 tasks
2
[Bug] accelerate ignores TPU
#3169 opened Oct 14, 2024 by steveepreston
1 of 4 tasks
1
dataloader doesn't load data while gpu is training
#3168 opened Oct 14, 2024 by geekifan
2 of 4 tasks
1
save_state() and load_state() do not work correctly with multi-gpu with shuffle=True in dataloader
#3158 opened Oct 11, 2024 by isayoften
2 of 4 tasks
how to load model with fp8 precision for inference?
#3156 opened Oct 11, 2024 by imrankh46
4 tasks done
1
loading big models into memory
#3153 opened Oct 10, 2024 by werruww
2 of 4 tasks
20
Pipeline parallelism examples with Pippy fails
#3151 opened Oct 9, 2024 by goelayu
1 of 4 tasks
@muellerzr
2
Using accelerate launch to initialize sagemaker job doesn't work properly with multiple GPUs
#3148 opened Oct 9, 2024 by BaldPulse
2 of 4 tasks
3
Duplicated process and memory leakage for evaluation process in all_gather
#3147 opened Oct 9, 2024 by SangbumChoi
2 of 4 tasks
1
2
Not compatible with h5py database
#3141 opened Oct 6, 2024 by Chrisa142857
2 of 4 tasks
save_state() fails when using DeepSpeed with multiple models where some models are frozen some are being trained bug Something isn't working contributions-welcome deepspeed DS related issues/PRs
#3140 opened Oct 3, 2024 by enesmsahin
3 of 4 tasks
@muellerzr
2
FSDP, AMP, and Accelerate together
#3139 opened Oct 2, 2024 by cinjon
3
_prepare_deepspeed fail to capture correct kwargs with DummyOptim or DummyScheduler when calling prepare() multiple times
#3134 opened Sep 30, 2024 by Jason3900
2 of 4 tasks
3
The incorrect hook mounting caused the tensor to be on different devices.
#3127 opened Sep 24, 2024 by rangehow
2 of 4 tasks
4
Error running notebook launcher in google Colab
#3126 opened Sep 21, 2024 by emusiienko
3 of 4 tasks
7
Iterating over sharded dataset not working properly with Multi GPUs
#3124 opened Sep 20, 2024 by AMSolin
2 of 4 tasks
1
ProTip! Add no:assignee to see everything that’s not assigned.