Skip to content

Add KV replicate feature when kv_head<tp_size - #47811

Closed
kaixuanliu wants to merge 17 commits into
huggingface:mainfrom
kaixuanliu:kv-replicate
Closed

Add KV replicate feature when kv_head<tp_size#47811
kaixuanliu wants to merge 17 commits into
huggingface:mainfrom
kaixuanliu:kv-replicate

only consider fwd path

a9e38e6
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Get PR number / Get PR number
succeeded Sep 2, 2026 in 2s