Skip to content

feat(decider): bounded request-local CUDA batching - #111

Merged
MrDongsls merged 11 commits into
InferMatrixLab:mainfrom
Levius-Fubuki:codex/decider-request-batching
Oct 14, 2026
Merged

MrDongsls merged 11 commits into
InferMatrixLab:mainfrom
Levius-Fubuki:codex/decider-request-batching

Commits

  1. Commits on Oct 7, 2026

  2. Commits on Oct 8, 2026

  3. Commits on Oct 9, 2026

  4. Commits on Oct 10, 2026

  5. Commits on Oct 12, 2026

  6. Commits on Oct 13, 2026