-
Notifications
You must be signed in to change notification settings - Fork 45
Pull requests: gittensor-ai-lab/sparkinfer
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
perf(qwen3.6): qknorm int8 + gated fuses — +36 tok/s @12k atop #282
#294
opened Jul 9, 2026 by
jimcody1995
Contributor
Loading…
2 of 3 tasks
fix(runtime): validate routed-expert tensor shapes in Qwen GGUF loader
area:runtime
subsystem (emission weight 0.26)
not-tested
Awaiting maintainer approval to run on RTX 5090; not evaluated
#292
opened Jul 9, 2026 by
RealDiligent
Loading…
fix(runtime): thread seq_id through decode_layer's KV block-table lookup
area:runtime
subsystem (emission weight 0.26)
not-tested
Awaiting maintainer approval to run on RTX 5090; not evaluated
#290
opened Jul 9, 2026 by
dale053
Loading…
5 tasks
Opt/gdn conv l2norm
area:kernels
subsystem (emission weight 0.42)
area:runtime
subsystem (emission weight 0.26)
eval:REJECT
sparkinfer auto-eval verdict: REJECT
test-on-5090
Maintainer-approved to evaluate on RTX 5090 (greenlight)
perf(qwen3.6): fuse Q-gate + O-proj Q8_1 quantize into one launch
128-context
UI-only: strongest measured context in sparkinfer eval
area:kernels
subsystem (emission weight 0.42)
area:runtime
subsystem (emission weight 0.26)
eval:none
sparkinfer auto-eval verdict: none
test-on-5090
Maintainer-approved to evaluate on RTX 5090 (greenlight)
#283
opened Jul 8, 2026 by
galuis116
Contributor
Loading…
1 task done
perf(decode): pack2 MMVQ for attention Q4_K Wq and O projections
128-context
UI-only: strongest measured context in sparkinfer eval
area:kernels
subsystem (emission weight 0.42)
area:runtime
subsystem (emission weight 0.26)
eval:none
sparkinfer auto-eval verdict: none
test-on-5090
Maintainer-approved to evaluate on RTX 5090 (greenlight)
#272
opened Jul 6, 2026 by
claytonlin1110
Loading…
1 task done
perf(moe): Q5_K fp split-K Qwen specialization + gate_up F=512 dispatch (+4.3% Qwen3.6 decode)
128-context
UI-only: strongest measured context in sparkinfer eval
area:kernels
subsystem (emission weight 0.42)
area:runtime
subsystem (emission weight 0.26)
eval:M
sparkinfer auto-eval verdict: M
needs-rebase
Verified speedup but not the round winner — rebase after merge-first lands
test-on-5090
Maintainer-approved to evaluate on RTX 5090 (greenlight)
#267
opened Jul 6, 2026 by
inference2026
Contributor
•
Draft
1 task done
perf(qwen3.6): fuse decode kernel launches — shared-expert + GDN conv/L2-norm
128-context
UI-only: strongest measured context in sparkinfer eval
area:kernels
subsystem (emission weight 0.42)
area:runtime
subsystem (emission weight 0.26)
eval:M
sparkinfer auto-eval verdict: M
needs-rebase
Verified speedup but not the round winner — rebase after merge-first lands
test-on-5090
Maintainer-approved to evaluate on RTX 5090 (greenlight)
#239
opened Jul 5, 2026 by
minion1227
Loading…
1 task done
perf(qwen36): retune GEMV/router/MoE decode scheduling
128-context
UI-only: strongest measured context in sparkinfer eval
area:kernels
subsystem (emission weight 0.42)
eval:none
sparkinfer auto-eval verdict: none
needs-benchmark
Box ticked but decode before/after not filled with a real improvement — not evaluated
#237
opened Jul 5, 2026 by
9876543210-tc-0123456789
Contributor
Loading…
3 tasks done
perf(qwen3.6): default the merged gdn_ar_fast_kernel ON
area:kernels
subsystem (emission weight 0.42)
needs-benchmark
Box ticked but decode before/after not filled with a real improvement — not evaluated
#236
opened Jul 5, 2026 by
jaso0n0818
Contributor
Loading…
1 task done
perf(decode): lower adaptive 256-split threshold for long-context flash decode
area:kernels
subsystem (emission weight 0.42)
area:runtime
subsystem (emission weight 0.26)
needs-benchmark
Box ticked but decode before/after not filled with a real improvement — not evaluated
#194
opened Jul 3, 2026 by
thomasalvaedison7777-lgtm
Loading…
7 of 8 tasks
runtime: add Gemma 4 26B-A4B end-to-end decode path
area:runtime
subsystem (emission weight 0.26)
not-tested
Awaiting maintainer approval to run on RTX 5090; not evaluated
#85
opened Jun 28, 2026 by
andriypolanski
Loading…
5 tasks done
ProTip!
Follow long discussions with comments:>50.