Skip to content

Issues: huggingface/optimum-neuron

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
23 Open 729 Closed
23 Open 729 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Use AWS Neuron sdk 2.21
#754 opened Dec 23, 2024 by dacorvo Loading…
1
Support for Llama 3.3 (transformers >= 4.45.0)
#752 opened Dec 20, 2024 by alessandro-zucca
Document how to use Qwen 2.5
#750 opened Dec 17, 2024 by pagezyhf
Qwen 2.5 tutorial Stale
#749 opened Dec 17, 2024 by pagezyhf Loading…
2
Support for Qwen2-VL
#747 opened Dec 9, 2024 by Chin-Vic
Loading compiled fails: model_type=bert -> transformers being used in compiled config. bug Something isn't working Stale
#744 opened Dec 2, 2024 by michaelfeil
@JingyaHuang
3
Loss too big when using TP Stale
#740 opened Nov 22, 2024 by michaelbenayoun • Draft
1 task
2
Make the Parallelizer class work for inference
#715 opened Oct 10, 2024 by michaelbenayoun • Draft
2
can't compile llama-3-8B or llama-3.1-8B with lora if batch size is more than 1 bug Something isn't working
#709 opened Oct 5, 2024 by anilozlu
3 of 4 tasks
Move neuron_parallel_compile outside of bash script
#706 opened Sep 26, 2024 by jgray-aws
Codellama generates wierd tokens with TGI 0.0.24 bug Something isn't working
#704 opened Sep 25, 2024 by pinak-p
1 of 4 tasks
@dacorvo
5
ValueError: The NeuronTrainer only accept NeuronTrainingArguments, but <class 'optimum.neuron.training_args.Seq2SeqNeuronTrainingArguments'> was provided. bug Something isn't working
#693 opened Sep 6, 2024 by industrialeaf
2 of 4 tasks
@michaelbenayoun
Add support for LoRA with GQAQKVColumnParallelLinear
#690 opened Sep 5, 2024 by michaelbenayoun • Draft
1
Cannot host Llama-3-8B exported by optimum-neuron with TGI contianer using optimum-neuron(0.0.24) and neuron-sdk(2.19.1) bug Something isn't working
#684 opened Aug 25, 2024 by cszhz
2 of 4 tasks
3
Training output reports incorrect num examples when using DDP bug Something isn't working Stale
#683 opened Aug 24, 2024 by syl-taylor-aws
2 of 4 tasks
1
Enable use of IterableDataset when training with DDP
#681 opened Aug 23, 2024 by syl-taylor-aws
2
Add support for new Black Forest's model (Flux)
#676 opened Aug 6, 2024 by mrrfr
@JingyaHuang
6
MPMD errors when enabling pipeline parallel for fine-tuning llama 3 8B model bug Something isn't working Stale
#674 opened Jul 31, 2024 by bingchen-liu
2 of 4 tasks
2
Examples for E2E Mistral training & deployment
#673 opened Jul 30, 2024 by jonetiz Loading…
28
Underloaded Neuron Cores with Llama3 bug Something isn't working Stale
#672 opened Jul 30, 2024 by dlptv
2 of 4 tasks
2
[DO NOT MERGE] Restore non-inlined SDXL Stale
#668 opened Jul 25, 2024 by JingyaHuang • Draft
3 tasks
5
Llama 3 8B fine tuning shows nan value as loss bug Something isn't working Stale
#660 opened Jul 20, 2024 by BaiqingL
2 of 4 tasks
4
Llama3-8B finetuning shows runtime error of TDRV:v2_cc_execute bug Something isn't working Stale
#658 opened Jul 17, 2024 by jianyinglangaws
3
ProTip! no:milestone will show everything without a milestone.