Skip to content

Fix MTP layer and block sharding under explicit 2D and FSDP sharding. - #4703

Merged
copybara-service[bot] merged 1 commit into
mainfrom
test_957530795
Aug 4, 2026
Merged

Fix MTP layer and block sharding under explicit 2D and FSDP sharding.#4703
copybara-service[bot] merged 1 commit into
mainfrom
test_957530795

Conversation

@copybara-service

@copybara-service copybara-service Bot commented Aug 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Fix MTP layer and block sharding under explicit 2D and FSDP sharding.

@copybara-service
copybara-service Bot force-pushed the test_957530795 branch 4 times, most recently from f6a32c2 to e7e0b97 Compare August 4, 2026 06:59
@copybara-service copybara-service Bot changed the title Optimize Multi-Token Prediction (MTP) sharding and memory footprint. Optimize Multi-Token Prediction (MTP) sharding and memory footprint under FSDP. Aug 4, 2026
@codecov

codecov Bot commented Aug 4, 2026 •
edited
Loading

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@copybara-service copybara-service Bot changed the title Optimize Multi-Token Prediction (MTP) sharding and memory footprint under FSDP. Fix MTP layer and block sharding under explicit 2D and FSDP sharding. Aug 4, 2026
@copybara-service
copybara-service Bot force-pushed the test_957530795 branch 2 times, most recently from 85cbb25 to 6b17668 Compare August 4, 2026 18:58
@copybara-service
copybara-service Bot merged commit 9977b5d into main Aug 4, 2026
@copybara-service
copybara-service Bot deleted the test_957530795 branch August 4, 2026 20:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@parambole parambole Awaiting requested review from parambole parambole is a code owner
@RissyRan RissyRan Awaiting requested review from RissyRan RissyRan is a code owner
@gagika gagika Awaiting requested review from gagika gagika is a code owner
@richjames0 richjames0 Awaiting requested review from richjames0 richjames0 is a code owner
@shralex shralex Awaiting requested review from shralex shralex is a code owner
@darisoy darisoy Awaiting requested review from darisoy darisoy is a code owner
@igorts-git igorts-git Awaiting requested review from igorts-git igorts-git is a code owner
@abhinavclemson abhinavclemson Awaiting requested review from abhinavclemson abhinavclemson is a code owner
@gobbleturk gobbleturk Awaiting requested review from gobbleturk gobbleturk is a code owner
@khatwanimohit khatwanimohit Awaiting requested review from khatwanimohit khatwanimohit is a code owner
@bvandermoon bvandermoon Awaiting requested review from bvandermoon bvandermoon is a code owner
@vipannalla vipannalla Awaiting requested review from vipannalla vipannalla is a code owner
@SurbhiJainUSC SurbhiJainUSC Awaiting requested review from SurbhiJainUSC SurbhiJainUSC is a code owner
@hengtaoguo hengtaoguo Awaiting requested review from hengtaoguo hengtaoguo is a code owner
@A9isha A9isha Awaiting requested review from A9isha A9isha is a code owner
@aireenmei aireenmei Awaiting requested review from aireenmei aireenmei is a code owner
@NuojCheng NuojCheng Awaiting requested review from NuojCheng NuojCheng is a code owner
@jiangjy1982 jiangjy1982 Awaiting requested review from jiangjy1982 jiangjy1982 is a code owner
@dipannita08 dipannita08 Awaiting requested review from dipannita08 dipannita08 is a code owner
@xibinliu xibinliu Awaiting requested review from xibinliu xibinliu is a code owner
@huytransformer huytransformer Awaiting requested review from huytransformer huytransformer is a code owner

Assignees

@RissyRan RissyRan

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@RissyRan