Skip to content

Pull requests: gittensor-ai-lab/sparkinfer

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort

Pull requests list

perf(qwen3.6): qknorm int8 + gated fuses — +36 tok/s @12k atop #282
#294 opened Jul 9, 2026 by jimcody1995 Contributor Loading…
2 of 3 tasks
fix(runtime): validate routed-expert tensor shapes in Qwen GGUF loader area:runtime subsystem (emission weight 0.26) not-tested Awaiting maintainer approval to run on RTX 5090; not evaluated
#292 opened Jul 9, 2026 by RealDiligent Loading…
fix(runtime): thread seq_id through decode_layer's KV block-table lookup area:runtime subsystem (emission weight 0.26) not-tested Awaiting maintainer approval to run on RTX 5090; not evaluated
#290 opened Jul 9, 2026 by dale053 Loading…
5 tasks
Opt/gdn conv l2norm area:kernels subsystem (emission weight 0.42) area:runtime subsystem (emission weight 0.26) eval:REJECT sparkinfer auto-eval verdict: REJECT test-on-5090 Maintainer-approved to evaluate on RTX 5090 (greenlight)
#285 opened Jul 8, 2026 by Paral1995 Contributor Draft
1 task done
perf(qwen3.6): fuse Q-gate + O-proj Q8_1 quantize into one launch 128-context UI-only: strongest measured context in sparkinfer eval area:kernels subsystem (emission weight 0.42) area:runtime subsystem (emission weight 0.26) eval:none sparkinfer auto-eval verdict: none test-on-5090 Maintainer-approved to evaluate on RTX 5090 (greenlight)
#283 opened Jul 8, 2026 by galuis116 Contributor Loading…
1 task done
perf(decode): pack2 MMVQ for attention Q4_K Wq and O projections 128-context UI-only: strongest measured context in sparkinfer eval area:kernels subsystem (emission weight 0.42) area:runtime subsystem (emission weight 0.26) eval:none sparkinfer auto-eval verdict: none test-on-5090 Maintainer-approved to evaluate on RTX 5090 (greenlight)
#272 opened Jul 6, 2026 by claytonlin1110 Loading…
1 task done
perf(moe): Q5_K fp split-K Qwen specialization + gate_up F=512 dispatch (+4.3% Qwen3.6 decode) 128-context UI-only: strongest measured context in sparkinfer eval area:kernels subsystem (emission weight 0.42) area:runtime subsystem (emission weight 0.26) eval:M sparkinfer auto-eval verdict: M needs-rebase Verified speedup but not the round winner — rebase after merge-first lands test-on-5090 Maintainer-approved to evaluate on RTX 5090 (greenlight)
#267 opened Jul 6, 2026 by inference2026 Contributor Draft
1 task done
perf(qwen3.6): fuse decode kernel launches — shared-expert + GDN conv/L2-norm 128-context UI-only: strongest measured context in sparkinfer eval area:kernels subsystem (emission weight 0.42) area:runtime subsystem (emission weight 0.26) eval:M sparkinfer auto-eval verdict: M needs-rebase Verified speedup but not the round winner — rebase after merge-first lands test-on-5090 Maintainer-approved to evaluate on RTX 5090 (greenlight)
#239 opened Jul 5, 2026 by minion1227 Loading…
1 task done
perf(qwen36): retune GEMV/router/MoE decode scheduling 128-context UI-only: strongest measured context in sparkinfer eval area:kernels subsystem (emission weight 0.42) eval:none sparkinfer auto-eval verdict: none needs-benchmark Box ticked but decode before/after not filled with a real improvement — not evaluated
#237 opened Jul 5, 2026 by 9876543210-tc-0123456789 Contributor Loading…
3 tasks done
perf(qwen3.6): default the merged gdn_ar_fast_kernel ON area:kernels subsystem (emission weight 0.42) needs-benchmark Box ticked but decode before/after not filled with a real improvement — not evaluated
#236 opened Jul 5, 2026 by jaso0n0818 Contributor Loading…
1 task done
perf(decode): lower adaptive 256-split threshold for long-context flash decode area:kernels subsystem (emission weight 0.42) area:runtime subsystem (emission weight 0.26) needs-benchmark Box ticked but decode before/after not filled with a real improvement — not evaluated
#194 opened Jul 3, 2026 by thomasalvaedison7777-lgtm Loading…
7 of 8 tasks
runtime: add Gemma 4 26B-A4B end-to-end decode path area:runtime subsystem (emission weight 0.26) not-tested Awaiting maintainer approval to run on RTX 5090; not evaluated
#85 opened Jun 28, 2026 by andriypolanski Loading…
5 tasks done
ProTip! Follow long discussions with comments:>50.