Skip to content

Issues: huggingface/optimum-neuron

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

80 Open 198 Closed
80 Open 198 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

training loss while fine-tuning llama 3.1 with lora is very high compared to rtx 3090 bug Something isn't working
#721 opened Oct 18, 2024 by anilozlu
4 tasks done
1
running packages when running the "Supervised Fine-Tuning of Llama 3 8B on one AWS Trainium instance" sample bug Something isn't working
#720 opened Oct 17, 2024 by yahavb
2 of 4 tasks
2
stablediffusion (sdxl) ip-adapter support
#718 opened Oct 16, 2024 by Suprhimp
3
Add Optimum Neuron Containers support(0.0.25 with Neuron 2.20.0)
#713 opened Oct 8, 2024 by cszhz
1
can't compile llama-3-8B or llama-3.1-8B with lora if batch size is more than 1 bug Something isn't working
#709 opened Oct 5, 2024 by anilozlu
3 of 4 tasks
Move neuron_parallel_compile outside of bash script
#706 opened Sep 26, 2024 by jgray-aws
Codellama generates wierd tokens with TGI 0.0.24 bug Something isn't working
#704 opened Sep 25, 2024 by pinak-p
1 of 4 tasks
@dacorvo
5
Unable to resume training after saving checkpoint, while using Zero-1 Optimization bug Something isn't working
#694 opened Sep 9, 2024 by unography
2 of 4 tasks
@michaelbenayoun
1
ValueError: The NeuronTrainer only accept NeuronTrainingArguments, but <class 'optimum.neuron.training_args.Seq2SeqNeuronTrainingArguments'> was provided. bug Something isn't working
#693 opened Sep 6, 2024 by industrialeaf
2 of 4 tasks
@michaelbenayoun
Cannot host Llama-3-8B exported by optimum-neuron with TGI contianer using optimum-neuron(0.0.24) and neuron-sdk(2.19.1) bug Something isn't working
#684 opened Aug 25, 2024 by cszhz
2 of 4 tasks
3
Training output reports incorrect num examples when using DDP bug Something isn't working Stale
#683 opened Aug 24, 2024 by syl-taylor-aws
2 of 4 tasks
1
Enable use of IterableDataset when training with DDP
#681 opened Aug 23, 2024 by syl-taylor-aws
1
text-generation-inference docker builds are not reproducible due to missing Cargo.lock causing builds to fail on previous versions bug Something isn't working
#677 opened Aug 8, 2024 by charlesmelby
1 of 4 tasks
@dacorvo
3
Add support for new Black Forest's model (Flux)
#676 opened Aug 6, 2024 by mrrfr
@JingyaHuang
3
MPMD errors when enabling pipeline parallel for fine-tuning llama 3 8B model bug Something isn't working Stale
#674 opened Jul 31, 2024 by bingchen-liu
2 of 4 tasks
2
Underloaded Neuron Cores with Llama3 bug Something isn't working Stale
#672 opened Jul 30, 2024 by dlptv
2 of 4 tasks
2
Add support for Llama3.1
#664 opened Jul 24, 2024 by dacorvo
@dacorvo
8
Llama 3 8B fine tuning shows nan value as loss bug Something isn't working Stale
#660 opened Jul 20, 2024 by BaiqingL
2 of 4 tasks
2
Llama3-8B finetuning shows runtime error of TDRV:v2_cc_execute bug Something isn't working Stale
#658 opened Jul 17, 2024 by jianyinglangaws
3
stable diffusion with dynamic width, height
#653 opened Jul 16, 2024 by Suprhimp
3
Return logits probabilities for NeuronX TGI generated tokens
#639 opened Jun 24, 2024 by dacorvo
@dacorvo
4
Add support to read different neuron cache from the local directory of the DLC based on ENVs Stale
#535 opened Mar 28, 2024 by Neo9061
14
TGI NeuronX DLC (Optimum-neuron) 0.0.20: SageMaker deployment failure with llama-2 7B bug Something isn't working Stale
#516 opened Mar 14, 2024 by Neo9061
@dacorvo
15
Request TGI NeuronX DLC to support Flan T5 models in SageMaker enhancement New feature or request
#515 opened Mar 14, 2024 by Neo9061
8
Support Marian models inference new model Stale
#514 opened Mar 13, 2024 by JingyaHuang
1
ProTip! Mix and match filters to narrow down what you’re looking for.