Repository navigation

decider: reuse request prefixes with conservative auto selection - #113

Merged

hsliuustc0106 merged 49 commits into

InferMatrixLab:mainfrom

Levius-Fubuki:codex/decider-shared-prefix

Oct 24, 2026

Merged

decider: reuse request prefixes with conservative auto selection#113
hsliuustc0106 merged 49 commits into
InferMatrixLab:mainfrom
Levius-Fubuki:codex/decider-shared-prefix

Commits on Oct 7, 2026
- feat(decider): isolate CUDA Graph mode and expose replay evidence
  Levius-Fubuki
  committed
  d88179c
- qwen3_5: add prefix continuation operations
  
  twu3202
  authored and
  Levius-Fubuki
  committed
  cc93e80
- qwen3_5: add a GEMM handle with one algorithm per weight shape
  
  twu3202
  authored and
  Levius-Fubuki
  committed
  a0ece5c
- qwen3_5: run prompts that share prefixes once per prefix
  
  twu3202
  authored and
  Levius-Fubuki
  committed
  e596a24
- feat(decider): integrate request-local shared prefix execution
  Levius-Fubuki
  committed
  1126c0e
- docs(decider): restore exact validation commands and identifiers
  Levius-Fubuki
  committed
  6962971
Commits on Oct 8, 2026
Commits on Oct 9, 2026
Commits on Oct 10, 2026
Commits on Oct 12, 2026
- Merge verified Decider batching integration into graph replay
  Levius-Fubuki
  committed
  f17ac9a
- Merge Decider graph integration and align the Qwen ABI manifest
  Levius-Fubuki
  committed
  34d25af
Commits on Oct 13, 2026
Commits on Oct 15, 2026
- Merge current main after Decider batching landed
  Levius-Fubuki
  committed
  03bbb61
- Merge current Graph prerequisite and document fixed-mode device rollout and recovery
  Levius-Fubuki
  committed
  a631b8b
Commits on Oct 22, 2026
Commits on Oct 23, 2026
Commits on Oct 24, 2026
- Merge main and retain Graph, prefix and image decoding tests
  Levius-Fubuki
  committed
  f285b80