Repository navigation

Add KV replicate feature when kv_head<tp_size - #47811

Closed

kaixuanliu wants to merge 17 commits into

huggingface:mainfrom

kaixuanliu:kv-replicate

Closed

Add KV replicate feature when kv_head<tp_size#47811
kaixuanliu wants to merge 17 commits into
huggingface:mainfrom
kaixuanliu:kv-replicate

Commits on Aug 28, 2026
- add kv replicate feature when kv_heads<tp_size
  kaixuanliu
  committed
  4a78c79
- Merge branch 'main' into kv-replicate
  kaixuanliu
  authored
  b6431d8
- add kv replicate feature when kv_heads<tp_size
  kaixuanliu
  committed
  822327b
- Merge branch 'kv-replicate' of https://github.com/kaixuanliu/transformers into kv-replicate
  kaixuanliu
  committed
  3209bac
- update
  kaixuanliu
  committed
  5875e33
- add bwd
  kaixuanliu
  committed
  dbfdb76
Commits on Aug 31, 2026
- small fix
  kaixuanliu
  committed
  8019708
- reconsider 2D mesh
  kaixuanliu
  committed
  667b95c
- update
  kaixuanliu
  committed
  614e5ec
- consider EP scene
  kaixuanliu
  committed
  f2d746e
- add more tests
  kaixuanliu
  committed
  f883fb1
- update
  kaixuanliu
  committed
  4a3dc01
Commits on Sep 1, 2026
- Update src/transformers/distributed/mixin.py
  
  kaixuanliu
  and
  ArthurZucker
  authored
  7f05b79
- avoid adjusting API
  kaixuanliu
  committed
  62954d3
Commits on Sep 2, 2026
- refactor
  kaixuanliu
  committed
  357c7b0
- update
  kaixuanliu
  committed
  b00e776
- only consider fwd path
  kaixuanliu
  committed
  a9e38e6