Skip to content

[MoE Layer] Support MoE Drop Tokens#248

Open
hushenwei2000 wants to merge 5 commits intoPaddlePaddle:developfrom
hushenwei2000:moe_drop_tokens
Open

[MoE Layer] Support MoE Drop Tokens#248
hushenwei2000 wants to merge 5 commits intoPaddlePaddle:developfrom
hushenwei2000:moe_drop_tokens

Conversation

@hushenwei2000
Copy link
Collaborator

@hushenwei2000 hushenwei2000 commented Dec 24, 2025

支持丢 Tokens 逻辑,与 PaddleFormers PaddlePaddle/PaddleFormers#3291 对齐。

  • 新增 moe_token_drop_policy
  • 新增 moe_expert_capacity_factor

@codecov-commenter
Copy link

Codecov Report

❌ Patch coverage is 28.57143% with 20 lines in your changes missing coverage. Please review.
⚠️ Please upload report for BASE (develop@938973c). Learn more about missing BASE report.

⚠️ Current head 091a08d differs from pull request most recent head eb0d061

Please upload reports for the commit eb0d061 to get more accurate results.

Files with missing lines Patch % Lines
src/paddlefleet/transformer/moe/moe_router.py 28.57% 19 Missing and 1 partial ⚠️

❌ Your patch status has failed because the patch coverage (28.57%) is below the target coverage (90.00%). You can increase the patch coverage or adjust the target coverage.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             develop     #248   +/-   ##
==========================================
  Coverage           ?   28.57%           
==========================================
  Files              ?        1           
  Lines              ?       28           
  Branches           ?        5           
==========================================
  Hits               ?        8           
  Misses             ?       19           
  Partials           ?        1           
Flag Coverage Δ
coverage_combine 28.57% <28.57%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines Coverage Δ
src/paddlefleet/transformer/moe/moe_router.py 28.57% <28.57%> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants