Repository navigation

refactor: add engine and scheduler seams for multi-row decode steps - #833

Merged

jason-fxz merged 9 commits into

mainfrom

refactor/multi-row-decode-seams

Oct 27, 2026

Merged

refactor: add engine and scheduler seams for multi-row decode steps#833
jason-fxz merged 9 commits into
mainfrom
refactor/multi-row-decode-seams

Commits on Oct 27, 2026
- refactor: add engine and scheduler seams for multi-row decode steps
  jason-fxz
  committed
  b7bddc3
- refactor: rename the graph steps argument to rows_per_req
  jason-fxz
  committed
  e46f0c0
- refactor: drop VerifyInfo and require rows_per_req on verify batches
  jason-fxz
  committed
  55628a1
- refactor: fix stale seam comments and read decode_rows_per_req directly
  jason-fxz
  committed
  bd5e7d5
- chore: merge main
  jason-fxz
  committed
  c21b961
- refactor: reword two GraphRunner comments for multi-row graphs
  jason-fxz
  committed
  3b8f873
- fix(engine): scale the GPU-decode MoE pool limits by decode_rows_per_req
  jason-fxz
  committed
  6d52946
- refactor: drop the unread Context.moe_offload_cache field
  jason-fxz
  committed
  1cb80f7
- test: trim the multi-row seam tests
  jason-fxz
  committed
  49b52c6