diff --git a/docs/reference-matrix.md b/docs/reference-matrix.md index ee72605f..9a472fd7 100644 --- a/docs/reference-matrix.md +++ b/docs/reference-matrix.md @@ -207,6 +207,18 @@ SSD/OS systems columns. | **A1 / Agent Skills** @ `69ef37e9424c0a7ea9dd2293b559e43ec8176379` | reference; Dot A-approved minimal consumption | Specification frontmatter/body/progressive disclosure and client guide catalog/activation/resource sections directly verified 2026-10-15; format guidance, not an execution permission grant | `src/inferrsi/skill_catalog.py`, existing CLI/arguments; metadata projection + explicit selection + resource resolution; no installer/router/client configuration | | **CR6 / Stas Bekman ML Engineering Open Book** @ `ee7517e0f562ff0e7d56c3e88c619d0c0c496ba7` (CC BY-SA 4.0 declared by source skill) | expert methodology | `skills/ml-engineering/SKILL.md` scoped principles, `skills/evaluate-cluster/SKILL.md` first 100 lines, targeted performance README MFU/HFU/NUMA/GC sections; scripts identified only, excluded storage/input/recovery lanes not mined | `training-resource-budget` + explicitly attributed/share-alike `references/stas-decision-notes.md`; Accelerator/RAM/Network/OS diagnosis and proposed verification, no local results | +### Foundational mechanism decisions + +The [six-case guide](../src/inferrsi/data/skill_library/methods/optimization-search-policy/references/foundational-mechanism-decisions.md) +consolidates existing vLLM admission/KV ledgers at `7f730b4cea9a66520a9200265928ebe016b48a39`, +Orca OSDI22/FastServe v3, the LMCache MP historical prefix `c3b875a`, +the Qwen B300 H6/H7 rejection record at `d51c941dc57807c1e16ea698cd9291f414110c45`, +Alpa v3 and AFD eager dense-FFN at `df8d6a0c403c3ca1b4ed9cf1687e7204908bebec`. +This adds decision navigation under `optimization-search-policy`, not new primary +inspection, a duplicate domain procedure or a selector. Original readsets, +inspection dates, historical-observation scope and candidate/not_run states remain +with the linked owners. No new hardware/resource qualification follows. + ### Reviewed paper methodology and cases The following paper versions supplement, rather than replace or certify, the diff --git a/docs/searchspace-matrix.md b/docs/searchspace-matrix.md index d18f9812..076ddf53 100644 --- a/docs/searchspace-matrix.md +++ b/docs/searchspace-matrix.md @@ -42,7 +42,7 @@ The primary compute and HBM resource. Most current work lives here. | **Diagnose / Configure / Verify** | AKG static CUDA Affine loop tails: effective target/option gates, full point-loop bounds and protected input/output accesses | [kernel-writing-guide](../src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md) | [Tail-guard reference](../src/inferrsi/data/skill_library/methods/kernel-writing-guide/references/akg-affine-tail-guards.md): separation precedence, non-divisible fixture and diagnostic boundary | AKG @ 5aa15f3fe4d856eb60cd3b27447e04f5f1fb4dff; source + FileCheck expectations only | Candidate; compiler/IR command, CUDA runtime and agent efficacy not run; no new measured coverage | | **Optimize** | Operator-level: staged accuracy-gated tuning campaign (code-level → scheduling → instruction-level), metric→action routing; AscendC tiling design per operator class (reduction/broadcast/elewise/matmul/conversion) | `ascend-operator-tuning`, `ascendc-tiling-design` | PyPTO frontend/swimlane/incore playbooks; fullload-vs-split, four-element tiling template, chip-generation (DAV_2201/3510) routing | awesome-ascend-skills pypto-op-perf-tune + ascendc-tiling-design @ 75ec89c | 🟢 | | **Optimize** | Casebook of past NPU optimization decisions: AI-CPU fallback, memory-bound, comm-exposed, graph-compilation, scheduling idle gaps | `ascend-optimization-casebook`, `inference-optimization-casebook` | Five bottleneck classes with symptom→diagnosis→action→evidence schema | MindIE-SD profiling-analyze + dit-perf-opt + perf-gate + dit-parallel-opt @ 8481d39b | 🟢 | -| **Optimize** | Bounded experiment selection, distinct mechanism hypotheses, incumbent preservation and final-artifact integrity | `optimization-search-policy` | Methodology provenance stays in Reference Matrix §2; no hardware coverage from agent-paper scores | vllm-evolve @ 43cc82c; scoped A/F paper amendments | 🟢 (procedure only) | +| **Optimize** | Bounded experiment selection, distinct mechanism hypotheses, incumbent preservation and final-artifact integrity; scheduling, caching/reuse and parallelism/pipelining decision navigation | [optimization-search-policy](../src/inferrsi/data/skill_library/methods/optimization-search-policy/SKILL.md) | [Six bounded cases](../src/inferrsi/data/skill_library/methods/optimization-search-policy/references/foundational-mechanism-decisions.md); training-only and historical-negative boundaries retained | Existing owner ledgers consolidated; provenance stays in Reference Matrix §2; no new hardware coverage or automatic selection; vllm-evolve @ 43cc82c; scoped A/F paper amendments and linked existing cases | 🟢 (candidate procedure; mechanism selection/efficacy not evaluated) | | **Optimize** | Bounded multistream overlap: dependency-DAG constrained (data/state/event/collective_order edges; shared input ≠ dependency), minimal-first, execution-mode sync contract (eager streams vs TorchAir) | `cann-attribution-overlap` | Metric separation (wall / union-of-busy / summed durations / summed duration+wait; repeated-instance product = estimate); device-memory domain qualification; formula conflicts carried unresolved | cann/oam-tools @ 8440935f (pack-mediated, wave 6) | 🟢 | | **Verify** | Evidence taxonomy (L0 correctness → L5 production), claim-evidence matching | `dense-performance-evidence`, `rsi-evidence`, `claim-contract` | InferRSI PASS/FAIL/INCONCLUSIVE protocol | InferRSI @ 4c8e1285 | 🟢 | | **Diagnose / Verify** | Fixed-stage PyTorch/Ascend model report: bind current stage and actually loaded candidate to quality-validator output and comparable baseline | [ascend-performance-analysis](../src/inferrsi/data/skill_library/hardware/ascend/ascend-performance-analysis/SKILL.md) | [Stage-evidence rule](../src/inferrsi/data/skill_library/hardware/ascend/ascend-performance-analysis/references/cannbot-stage-evidence.md): workflow instructions versus registered marker/keyword checks; completion is not numerical validation | canonical cann/cannbot @ c0e2ad23ee1a73e3c0f84c8df1cc459e2aae3110; selected CANN-2.0 scope | Candidate procedure only; host/model/backend not_run, agent efficacy not evaluated; no new measured coverage | diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/README.md b/src/inferrsi/data/repo_packs/inferrsi/knowledge/README.md index 5113cc5e..3044d470 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/README.md +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/README.md @@ -15,7 +15,7 @@ These are knowledge abstracts (`--kind knowledge`), with namespaced package IDs distinct from explicitly selected `checkout_ref` skills. Ascend/CUDA procedures use their corresponding backend; shared methods use `common`. -Source snapshot: [933c3e31f2b6f4f7957216ac641bf5dbb63ba002](https://github.com/InferMatrixLab/InferRSI/tree/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library). +Source snapshot: [732769fd2611551b23e92e22f5564c09069453e5](https://github.com/InferMatrixLab/InferRSI/tree/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library). ```bash inferrsi knowledge search 'profiling' --repo-type inferrsi --limit 50 @@ -29,7 +29,7 @@ contain the current input paths and bytes (Git checkout filters are respected). ```bash python tools/build_skill_index.py --source-revision -python tools/build_skill_index.py --source-revision 933c3e31f2b6f4f7957216ac641bf5dbb63ba002 --check +python tools/build_skill_index.py --source-revision 732769fd2611551b23e92e22f5564c09069453e5 --check ``` `--check` detects missing, stale and unexpected generated records without writing. diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-aclgraph-capture-replay.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-aclgraph-capture-replay.json index fdf27223..f5f48471 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-aclgraph-capture-replay.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-aclgraph-capture-replay.json @@ -21,8 +21,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-device-health.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-device-health.json index 292d29e3..9f30558f 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-device-health.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-device-health.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-distributed-parallel.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-distributed-parallel.json index be1d1b4a..dcfefee5 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-distributed-parallel.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-distributed-parallel.json @@ -24,8 +24,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/ascend/ascend-distributed-parallel/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/ascend/ascend-distributed-parallel/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-distributed-parallel/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-distributed-parallel/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-graph-mode.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-graph-mode.json index 9ecd6626..6ede871e 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-graph-mode.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-graph-mode.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/ascend/ascend-graph-mode/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/ascend/ascend-graph-mode/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-graph-mode/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-graph-mode/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-model-adaptation.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-model-adaptation.json index af178ea5..36b5c416 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-model-adaptation.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-model-adaptation.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/ascend/ascend-model-adaptation/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/ascend/ascend-model-adaptation/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-model-adaptation/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-model-adaptation/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-profiling.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-profiling.json index 6152dc20..b599ef8a 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-profiling.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-profiling.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/ascend/ascend-operator-profiling/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/ascend/ascend-operator-profiling/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-operator-profiling/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-operator-profiling/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-tuning.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-tuning.json index ba419caa..134ff8ae 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-tuning.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-tuning.json @@ -24,8 +24,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/ascend/ascend-operator-tuning/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/ascend/ascend-operator-tuning/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-operator-tuning/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-operator-tuning/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-optimization-casebook.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-optimization-casebook.json index e7d77f61..b29fcc11 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-optimization-casebook.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-optimization-casebook.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/ascend/ascend-optimization-casebook/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/ascend/ascend-optimization-casebook/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-optimization-casebook/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-optimization-casebook/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-performance-analysis.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-performance-analysis.json index 7c823c67..8e86a586 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-performance-analysis.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-performance-analysis.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/ascend/ascend-performance-analysis/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/ascend/ascend-performance-analysis/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascend-performance-analysis/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascend-performance-analysis/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascendc-tiling-design.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascendc-tiling-design.json index 427d486d..19a72ffa 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascendc-tiling-design.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascendc-tiling-design.json @@ -24,8 +24,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/ascend/ascendc-tiling-design/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/ascend/ascendc-tiling-design/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/ascendc-tiling-design/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/ascendc-tiling-design/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/cann-attribution-overlap.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/cann-attribution-overlap.json index c65f4944..e70c98de 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/cann-attribution-overlap.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/cann-attribution-overlap.json @@ -24,8 +24,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/ascend/cann-attribution-overlap/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/ascend/cann-attribution-overlap/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/cann-attribution-overlap/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/cann-attribution-overlap/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-device-memory-lifecycle.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-device-memory-lifecycle.json index 05f17630..1af05303 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-device-memory-lifecycle.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-device-memory-lifecycle.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/ascend/torchnpu-device-memory-lifecycle/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/ascend/torchnpu-device-memory-lifecycle/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/torchnpu-device-memory-lifecycle/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/torchnpu-device-memory-lifecycle/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-pinned-host-memory-lifecycle.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-pinned-host-memory-lifecycle.json index 35c107b4..093e6e7c 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-pinned-host-memory-lifecycle.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-pinned-host-memory-lifecycle.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/ascend/torchnpu-pinned-host-memory-lifecycle/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/ascend/torchnpu-pinned-host-memory-lifecycle/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/ascend/torchnpu-pinned-host-memory-lifecycle/SKILL.md", "src/inferrsi/data/skill_library/hardware/ascend/torchnpu-pinned-host-memory-lifecycle/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-serving-preemption.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-serving-preemption.json index 0c2a0a5a..17ef34c0 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-serving-preemption.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-serving-preemption.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/assess-serving-preemption/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/assess-serving-preemption/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/assess-serving-preemption/SKILL.md", "src/inferrsi/data/skill_library/methods/assess-serving-preemption/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-split-backward-schedule.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-split-backward-schedule.json index af11704e..d7f8697f 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-split-backward-schedule.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-split-backward-schedule.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/assess-split-backward-schedule/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/assess-split-backward-schedule/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/assess-split-backward-schedule/SKILL.md", "src/inferrsi/data/skill_library/methods/assess-split-backward-schedule/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-h3-runtime-residency.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-h3-runtime-residency.json index 8d4460ad..5cda2127 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-h3-runtime-residency.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-h3-runtime-residency.json @@ -30,8 +30,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/repositories/h3-c/audit-h3-runtime-residency/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/repositories/h3-c/audit-h3-runtime-residency/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/repositories/h3-c/audit-h3-runtime-residency/LICENSE", "src/inferrsi/data/skill_library/repositories/h3-c/audit-h3-runtime-residency/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-llama-runtime-state.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-llama-runtime-state.json index c621b7eb..7fd51472 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-llama-runtime-state.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-llama-runtime-state.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/repositories/llama-cpp/audit-llama-runtime-state/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/repositories/llama-cpp/audit-llama-runtime-state/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/repositories/llama-cpp/audit-llama-runtime-state/SKILL.md", "src/inferrsi/data/skill_library/repositories/llama-cpp/audit-llama-runtime-state/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sd-cpp-residency.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sd-cpp-residency.json index 5d4b38de..c9385c2d 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sd-cpp-residency.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sd-cpp-residency.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/repositories/stable-diffusion-cpp/audit-sd-cpp-residency/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/repositories/stable-diffusion-cpp/audit-sd-cpp-residency/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/repositories/stable-diffusion-cpp/audit-sd-cpp-residency/LICENSE", "src/inferrsi/data/skill_library/repositories/stable-diffusion-cpp/audit-sd-cpp-residency/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sglang-diffusion-lifetimes.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sglang-diffusion-lifetimes.json index 5a8b7ae5..c4eadfef 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sglang-diffusion-lifetimes.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sglang-diffusion-lifetimes.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/repositories/sglang/audit-sglang-diffusion-lifetimes/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/repositories/sglang/audit-sglang-diffusion-lifetimes/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/repositories/sglang/audit-sglang-diffusion-lifetimes/LICENSE", "src/inferrsi/data/skill_library/repositories/sglang/audit-sglang-diffusion-lifetimes/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-vllm-kv-lifetimes.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-vllm-kv-lifetimes.json index 5a956fd0..d4d252ad 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-vllm-kv-lifetimes.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-vllm-kv-lifetimes.json @@ -21,8 +21,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/repositories/vllm/audit-vllm-kv-lifetimes/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/repositories/vllm/audit-vllm-kv-lifetimes/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/repositories/vllm/audit-vllm-kv-lifetimes/SKILL.md", "src/inferrsi/data/skill_library/repositories/vllm/audit-vllm-kv-lifetimes/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/bound-windowed-attention-replay.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/bound-windowed-attention-replay.json index 23e31057..9c73f9a4 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/bound-windowed-attention-replay.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/bound-windowed-attention-replay.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/repositories/deepinfer/bound-windowed-attention-replay/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/repositories/deepinfer/bound-windowed-attention-replay/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/repositories/deepinfer/bound-windowed-attention-replay/SKILL.md", "src/inferrsi/data/skill_library/repositories/deepinfer/bound-windowed-attention-replay/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/budget-speculative-verification.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/budget-speculative-verification.json index 8034267e..cb045085 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/budget-speculative-verification.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/budget-speculative-verification.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/repositories/deepinfer/budget-speculative-verification/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/repositories/deepinfer/budget-speculative-verification/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/repositories/deepinfer/budget-speculative-verification/SKILL.md", "src/inferrsi/data/skill_library/repositories/deepinfer/budget-speculative-verification/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/calibrate-serving-simulation.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/calibrate-serving-simulation.json index 15c3ae19..12b376f8 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/calibrate-serving-simulation.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/calibrate-serving-simulation.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/calibrate-serving-simulation/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/calibrate-serving-simulation/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/calibrate-serving-simulation/SKILL.md", "src/inferrsi/data/skill_library/methods/calibrate-serving-simulation/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cgroup-resource-controls.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cgroup-resource-controls.json index b2328395..a9c4a1c0 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cgroup-resource-controls.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cgroup-resource-controls.json @@ -25,8 +25,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/host/cgroup-resource-controls/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/host/cgroup-resource-controls/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/host/cgroup-resource-controls/SKILL.md", "src/inferrsi/data/skill_library/hardware/host/cgroup-resource-controls/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/checkpoint-recovery-consistency.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/checkpoint-recovery-consistency.json index fbfccf49..5b88de6c 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/checkpoint-recovery-consistency.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/checkpoint-recovery-consistency.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/checkpoint-recovery-consistency/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/checkpoint-recovery-consistency/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/checkpoint-recovery-consistency/SKILL.md", "src/inferrsi/data/skill_library/methods/checkpoint-recovery-consistency/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/choose-parallel-training-plan.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/choose-parallel-training-plan.json index 31c24c74..1f0ab802 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/choose-parallel-training-plan.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/choose-parallel-training-plan.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/choose-parallel-training-plan/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/choose-parallel-training-plan/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/choose-parallel-training-plan/SKILL.md", "src/inferrsi/data/skill_library/methods/choose-parallel-training-plan/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cite-check-downstream-pr.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cite-check-downstream-pr.json index e3b2b4b5..c709a713 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cite-check-downstream-pr.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cite-check-downstream-pr.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/workflows/cite-check-downstream-pr/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/workflows/cite-check-downstream-pr/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/skill-index.json", "src/inferrsi/data/skill_library/workflows/cite-check-downstream-pr/SKILL.md" diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/claim-contract.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/claim-contract.json index 32a2fe35..deb5a9f9 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/claim-contract.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/claim-contract.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/workflows/claim-contract/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/workflows/claim-contract/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/skill-index.json", "src/inferrsi/data/skill_library/workflows/claim-contract/SKILL.md" diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/comfy-ui.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/comfy-ui.json index 2da293c2..6f9f91eb 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/comfy-ui.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/comfy-ui.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/repositories/comfy-ui/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/repositories/comfy-ui/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/repositories/comfy-ui/LICENSE", "src/inferrsi/data/skill_library/repositories/comfy-ui/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/competitor-scan.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/competitor-scan.json index 1c68c49b..e3fff2a7 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/competitor-scan.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/competitor-scan.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/workflows/competitor-scan/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/workflows/competitor-scan/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/skill-index.json", "src/inferrsi/data/skill_library/workflows/competitor-scan/SKILL.md" diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dcp-async-save-performance.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dcp-async-save-performance.json index 2a6c75af..3b504384 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dcp-async-save-performance.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dcp-async-save-performance.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/frameworks/pytorch/dcp-async-save-performance/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/frameworks/pytorch/dcp-async-save-performance/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/frameworks/pytorch/dcp-async-save-performance/SKILL.md", "src/inferrsi/data/skill_library/frameworks/pytorch/dcp-async-save-performance/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dense-performance-evidence.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dense-performance-evidence.json index 373400d3..7c9ba1d6 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dense-performance-evidence.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dense-performance-evidence.json @@ -21,8 +21,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/dense-performance-evidence/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/dense-performance-evidence/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/dense-performance-evidence/SKILL.md", "src/inferrsi/data/skill_library/methods/dense-performance-evidence/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diagnose-vllm-admission-pressure.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diagnose-vllm-admission-pressure.json index a0035678..6940fb3f 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diagnose-vllm-admission-pressure.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diagnose-vllm-admission-pressure.json @@ -21,8 +21,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/repositories/vllm/diagnose-vllm-admission-pressure/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/repositories/vllm/diagnose-vllm-admission-pressure/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/repositories/vllm/diagnose-vllm-admission-pressure/SKILL.md", "src/inferrsi/data/skill_library/repositories/vllm/diagnose-vllm-admission-pressure/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diffusers-invocation-state.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diffusers-invocation-state.json index 8c916db4..df182841 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diffusers-invocation-state.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diffusers-invocation-state.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/frameworks/diffusers/diffusers-invocation-state/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/frameworks/diffusers/diffusers-invocation-state/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/frameworks/diffusers/diffusers-invocation-state/SKILL.md", "src/inferrsi/data/skill_library/frameworks/diffusers/diffusers-invocation-state/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/draft-acceptance-issue.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/draft-acceptance-issue.json index af60e849..45f99d43 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/draft-acceptance-issue.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/draft-acceptance-issue.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/workflows/draft-acceptance-issue/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/workflows/draft-acceptance-issue/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/skill-index.json", "src/inferrsi/data/skill_library/workflows/draft-acceptance-issue/SKILL.md" diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/evaluate-elastic-serving-placement.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/evaluate-elastic-serving-placement.json index 1ea2334f..96abec65 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/evaluate-elastic-serving-placement.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/evaluate-elastic-serving-placement.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/evaluate-elastic-serving-placement/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/evaluate-elastic-serving-placement/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/evaluate-elastic-serving-placement/SKILL.md", "src/inferrsi/data/skill_library/methods/evaluate-elastic-serving-placement/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/generation-cache-lifecycle.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/generation-cache-lifecycle.json index 4fcc1614..2c523c26 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/generation-cache-lifecycle.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/generation-cache-lifecycle.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/repositories/mlx-lm/generation-cache-lifecycle/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/repositories/mlx-lm/generation-cache-lifecycle/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/repositories/mlx-lm/generation-cache-lifecycle/SKILL.md", "src/inferrsi/data/skill_library/repositories/mlx-lm/generation-cache-lifecycle/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-memory-management.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-memory-management.json index cfe27f97..57408328 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-memory-management.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-memory-management.json @@ -27,8 +27,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/host/host-memory-management/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/host/host-memory-management/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/host/host-memory-management/SKILL.md", "src/inferrsi/data/skill_library/hardware/host/host-memory-management/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-overhead-optimization.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-overhead-optimization.json index 82f9d650..a3279aad 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-overhead-optimization.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-overhead-optimization.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/host/host-overhead-optimization/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/host/host-overhead-optimization/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/host/host-overhead-optimization/SKILL.md", "src/inferrsi/data/skill_library/hardware/host/host-overhead-optimization/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-benchmark-design.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-benchmark-design.json index d61c7273..a7ccb4f0 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-benchmark-design.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-benchmark-design.json @@ -30,8 +30,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/inference-benchmark-design/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/inference-benchmark-design/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/inference-benchmark-design/SKILL.md", "src/inferrsi/data/skill_library/methods/inference-benchmark-design/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-optimization-casebook.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-optimization-casebook.json index be87c217..98ef3f34 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-optimization-casebook.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-optimization-casebook.json @@ -21,8 +21,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/inference-optimization-casebook/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/inference-optimization-casebook/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/inference-optimization-casebook/SKILL.md", "src/inferrsi/data/skill_library/methods/inference-optimization-casebook/cases/admission-drain-occupancy.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kernel-writing-guide.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kernel-writing-guide.json index acb88527..620b405f 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kernel-writing-guide.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kernel-writing-guide.json @@ -27,8 +27,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/kernel-writing-guide/SKILL.md", "src/inferrsi/data/skill_library/methods/kernel-writing-guide/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kv-tier-management.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kv-tier-management.json index c505d739..76b21163 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kv-tier-management.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kv-tier-management.json @@ -24,8 +24,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/repositories/lmcache/kv-tier-management/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/repositories/lmcache/kv-tier-management/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/repositories/lmcache/kv-tier-management/SKILL.md", "src/inferrsi/data/skill_library/repositories/lmcache/kv-tier-management/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lazy-evaluation-stream-lifetimes.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lazy-evaluation-stream-lifetimes.json index f71db613..82297b39 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lazy-evaluation-stream-lifetimes.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lazy-evaluation-stream-lifetimes.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/frameworks/mlx/lazy-evaluation-stream-lifetimes/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/frameworks/mlx/lazy-evaluation-stream-lifetimes/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/frameworks/mlx/lazy-evaluation-stream-lifetimes/SKILL.md", "src/inferrsi/data/skill_library/frameworks/mlx/lazy-evaluation-stream-lifetimes/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/npu-skill-factory.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/npu-skill-factory.json index 1247e3db..9671f3d6 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/npu-skill-factory.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/npu-skill-factory.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/workflows/npu-skill-factory/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/workflows/npu-skill-factory/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/skill-index.json", "src/inferrsi/data/skill_library/workflows/npu-skill-factory/SKILL.md", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/optimization-search-policy.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/optimization-search-policy.json index f4490072..87ba7a2f 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/optimization-search-policy.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/optimization-search-policy.json @@ -21,11 +21,12 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/optimization-search-policy/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/optimization-search-policy/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/optimization-search-policy/SKILL.md", "src/inferrsi/data/skill_library/methods/optimization-search-policy/metadata.json", + "src/inferrsi/data/skill_library/methods/optimization-search-policy/references/foundational-mechanism-decisions.md", "src/inferrsi/data/skill_library/methods/optimization-search-policy/references/papers-20261015/INTEGRATION_NOTES.md", "src/inferrsi/data/skill_library/methods/optimization-search-policy/references/papers-20261015/MECHANISMS.md", "src/inferrsi/data/skill_library/methods/optimization-search-policy/references/papers-20261015/NEXT_GATE_LEADS.md", @@ -34,7 +35,7 @@ "src/inferrsi/data/skill_library/methods/optimization-search-policy/references/papers-20261015/updates/optimization-search-policy.md", "src/inferrsi/data/skill_library/skill-index.json" ], - "content_sha256": "882e7850b9b49ad692a2d11618701afe0f4e83727ea78df114be2029923c725a" + "content_sha256": "cd0171fc1b4c2ae1802c8e71ff4a0c5d6364eb970edbea3a7f827137f9220669" } ], "index_type": "packaged-skill", @@ -43,8 +44,9 @@ }, "checkout_ref": "checkout:optimization-search-policy", "source_files": { - "src/inferrsi/data/skill_library/methods/optimization-search-policy/SKILL.md": "882e7850b9b49ad692a2d11618701afe0f4e83727ea78df114be2029923c725a", - "src/inferrsi/data/skill_library/methods/optimization-search-policy/metadata.json": "113c761ae488055da7e59c77df2db4247a545fdaf558188f01bde4b0960123c6", + "src/inferrsi/data/skill_library/methods/optimization-search-policy/SKILL.md": "cd0171fc1b4c2ae1802c8e71ff4a0c5d6364eb970edbea3a7f827137f9220669", + "src/inferrsi/data/skill_library/methods/optimization-search-policy/metadata.json": "e5250f8526a527147113025caabaacef5c2d3fb3298d031c8d9a1c745abaa560", + "src/inferrsi/data/skill_library/methods/optimization-search-policy/references/foundational-mechanism-decisions.md": "57b6b30a5d47859e02ff1c97f29ff3f62d633ac35013c48370ace90d12ab625e", "src/inferrsi/data/skill_library/methods/optimization-search-policy/references/papers-20261015/INTEGRATION_NOTES.md": "157e74ba180426b279b548a729769f152bf18f9a78ffca4ebfcaf26b7d0c5292", "src/inferrsi/data/skill_library/methods/optimization-search-policy/references/papers-20261015/MECHANISMS.md": "18bb2f5d7e52773c516420a142edfb531d0b9c822a2934d60f3234ac1cb9d40e", "src/inferrsi/data/skill_library/methods/optimization-search-policy/references/papers-20261015/NEXT_GATE_LEADS.md": "16a264c7159f9c2c700ce8ba46e63f3e636b277c987da4970f6d2fa085fcb053", @@ -84,7 +86,8 @@ "references/papers-20261015/MECHANISMS.md", "references/papers-20261015/NEXT_GATE_LEADS.md", "references/papers-20261015/references/source-notes.md", - "references/papers-20261015/updates/optimization-search-policy.md" + "references/papers-20261015/updates/optimization-search-policy.md", + "references/foundational-mechanism-decisions.md" ], "references": [ "../inference-optimization-casebook/cases/qwen-b300-rejected-directions.md", @@ -92,7 +95,19 @@ "../inference-optimization-casebook/cases/qwen-ascend-rejected-directions.md", "../inference-optimization-casebook/cases/qwen-ascend-rejected-directions.json", "../inference-optimization-casebook/cases/drama3-rejected-directions.md", - "../inference-optimization-casebook/cases/drama3-rejected-directions.json" + "../inference-optimization-casebook/cases/drama3-rejected-directions.json", + "../performance-ceiling-analysis/SKILL.md", + "../assess-serving-preemption/SKILL.md", + "../assess-serving-preemption/references/source-notes.md", + "../../repositories/vllm/diagnose-vllm-admission-pressure/SKILL.md", + "../../repositories/vllm/diagnose-vllm-admission-pressure/references/source-notes.md", + "../../repositories/vllm/audit-vllm-kv-lifetimes/SKILL.md", + "../../repositories/vllm/audit-vllm-kv-lifetimes/references/source-notes.md", + "../../repositories/lmcache/kv-tier-management/SKILL.md", + "../choose-parallel-training-plan/SKILL.md", + "../choose-parallel-training-plan/references/source-notes.md", + "../../repositories/afd-plugin/audit-afd-p2p-exchanges/SKILL.md", + "../../repositories/afd-plugin/audit-afd-p2p-exchanges/references/source-notes.md" ], "consumption_mode": "packaged" }, diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/os-process-placement.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/os-process-placement.json index cb5efe46..368bb29d 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/os-process-placement.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/os-process-placement.json @@ -24,8 +24,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/host/os-process-placement/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/host/os-process-placement/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/host/os-process-placement/SKILL.md", "src/inferrsi/data/skill_library/hardware/host/os-process-placement/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/performance-ceiling-analysis.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/performance-ceiling-analysis.json index c7d79b63..7dfa543e 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/performance-ceiling-analysis.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/performance-ceiling-analysis.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/performance-ceiling-analysis/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/performance-ceiling-analysis/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/performance-ceiling-analysis/SKILL.md", "src/inferrsi/data/skill_library/methods/performance-ceiling-analysis/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/plan-activation-residency.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/plan-activation-residency.json index 87a7c4cb..4c5969b6 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/plan-activation-residency.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/plan-activation-residency.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/plan-activation-residency/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/plan-activation-residency/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/plan-activation-residency/SKILL.md", "src/inferrsi/data/skill_library/methods/plan-activation-residency/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/repository-evolution-analysis.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/repository-evolution-analysis.json index 690d1364..5b8f317f 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/repository-evolution-analysis.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/repository-evolution-analysis.json @@ -21,8 +21,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/repository-evolution-analysis/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/repository-evolution-analysis/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/repository-evolution-analysis/SKILL.md", "src/inferrsi/data/skill_library/methods/repository-evolution-analysis/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/rsi-evidence.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/rsi-evidence.json index 2488e7bd..58780c06 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/rsi-evidence.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/rsi-evidence.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/workflows/rsi-evidence/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/workflows/rsi-evidence/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/skill-index.json", "src/inferrsi/data/skill_library/workflows/rsi-evidence/SKILL.md" diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/skill-evolution-playbook.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/skill-evolution-playbook.json index 9a492e08..c6f95d45 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/skill-evolution-playbook.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/skill-evolution-playbook.json @@ -21,8 +21,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/skill-evolution-playbook/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/skill-evolution-playbook/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/skill-evolution-playbook/SKILL.md", "src/inferrsi/data/skill_library/methods/skill-evolution-playbook/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/storage-io-measurement.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/storage-io-measurement.json index 16d5d404..f9cdecc6 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/storage-io-measurement.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/storage-io-measurement.json @@ -24,8 +24,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/host/storage-io-measurement/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/host/storage-io-measurement/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/host/storage-io-measurement/SKILL.md", "src/inferrsi/data/skill_library/hardware/host/storage-io-measurement/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-input-pipeline.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-input-pipeline.json index ea6f6294..547f8106 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-input-pipeline.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-input-pipeline.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/training-input-pipeline/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/training-input-pipeline/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/training-input-pipeline/SKILL.md", "src/inferrsi/data/skill_library/methods/training-input-pipeline/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-resource-budget.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-resource-budget.json index c2b0c35b..6621b665 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-resource-budget.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-resource-budget.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/training-resource-budget/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/training-resource-budget/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/training-resource-budget/SKILL.md", "src/inferrsi/data/skill_library/methods/training-resource-budget/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/weight-loading-optimization.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/weight-loading-optimization.json index befbb970..f552fced 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/weight-loading-optimization.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/weight-loading-optimization.json @@ -26,8 +26,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/methods/weight-loading-optimization/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/methods/weight-loading-optimization/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/methods/weight-loading-optimization/SKILL.md", "src/inferrsi/data/skill_library/methods/weight-loading-optimization/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/audit-afd-p2p-exchanges.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/audit-afd-p2p-exchanges.json index 5eb85a4c..776b9276 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/audit-afd-p2p-exchanges.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/audit-afd-p2p-exchanges.json @@ -23,8 +23,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/repositories/afd-plugin/audit-afd-p2p-exchanges/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/repositories/afd-plugin/audit-afd-p2p-exchanges/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/repositories/afd-plugin/audit-afd-p2p-exchanges/SKILL.md", "src/inferrsi/data/skill_library/repositories/afd-plugin/audit-afd-p2p-exchanges/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/diagnose-attention-bottlenecks.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/diagnose-attention-bottlenecks.json index 20257222..a55dc390 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/diagnose-attention-bottlenecks.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/diagnose-attention-bottlenecks.json @@ -16,8 +16,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/cuda/diagnose-attention-bottlenecks/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/cuda/diagnose-attention-bottlenecks/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/cuda/diagnose-attention-bottlenecks/SKILL.md", "src/inferrsi/data/skill_library/hardware/cuda/diagnose-attention-bottlenecks/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/host-overhead-profiling.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/host-overhead-profiling.json index 5d076d75..660b6edf 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/host-overhead-profiling.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/host-overhead-profiling.json @@ -22,8 +22,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/cuda/host-overhead-profiling/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/cuda/host-overhead-profiling/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/cuda/host-overhead-profiling/SKILL.md", "src/inferrsi/data/skill_library/hardware/cuda/host-overhead-profiling/metadata.json", diff --git a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/reason-hopper-kernels.json b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/reason-hopper-kernels.json index fad0f0e2..b7f83025 100644 --- a/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/reason-hopper-kernels.json +++ b/src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/reason-hopper-kernels.json @@ -36,8 +36,8 @@ "sources": [ { "type": "git", - "url": "https://github.com/InferMatrixLab/InferRSI/blob/933c3e31f2b6f4f7957216ac641bf5dbb63ba002/src/inferrsi/data/skill_library/hardware/cuda/reason-hopper-kernels/SKILL.md", - "commit": "933c3e31f2b6f4f7957216ac641bf5dbb63ba002", + "url": "https://github.com/InferMatrixLab/InferRSI/blob/732769fd2611551b23e92e22f5564c09069453e5/src/inferrsi/data/skill_library/hardware/cuda/reason-hopper-kernels/SKILL.md", + "commit": "732769fd2611551b23e92e22f5564c09069453e5", "paths": [ "src/inferrsi/data/skill_library/hardware/cuda/reason-hopper-kernels/SKILL.md", "src/inferrsi/data/skill_library/hardware/cuda/reason-hopper-kernels/metadata.json", diff --git a/src/inferrsi/data/skill_library/README.md b/src/inferrsi/data/skill_library/README.md index 1e41f230..97ded740 100644 --- a/src/inferrsi/data/skill_library/README.md +++ b/src/inferrsi/data/skill_library/README.md @@ -55,6 +55,13 @@ The historical short pin resolves to [`bc8115ed7fdc7e500320b5de70742ef049b4c1a2` The [Reference Matrix](https://github.com/InferMatrixLab/InferRSI/blob/main/docs/reference-matrix.md) retains the older `bc8115ed` Dockerfile/thread-env shipping-default scope under [os-process-placement](hardware/host/os-process-placement/SKILL.md). ACLGraph capture/replay supplies no new OS-control evidence; see the [OS/System row](https://github.com/InferMatrixLab/InferRSI/blob/main/docs/searchspace-matrix.md#5--os--system). +## Foundational mechanism decisions + +The [optimization-search-policy decision guide](methods/optimization-search-policy/references/foundational-mechanism-decisions.md) +compares six scheduling, caching/reuse and parallelism/pipelining situations using +existing owner evidence. It preserves source versions and historical negatives; +retrieval checks do not establish automatic method selection or measured gains. + ## Focused llama.cpp runtime audit The registered [audit-llama-runtime-state](repositories/llama-cpp/audit-llama-runtime-state/SKILL.md) diff --git a/src/inferrsi/data/skill_library/methods/optimization-search-policy/SKILL.md b/src/inferrsi/data/skill_library/methods/optimization-search-policy/SKILL.md index eb00f2e9..72e84bbb 100644 --- a/src/inferrsi/data/skill_library/methods/optimization-search-policy/SKILL.md +++ b/src/inferrsi/data/skill_library/methods/optimization-search-policy/SKILL.md @@ -21,6 +21,14 @@ An optimization agent without a search policy tends to: This skill addresses all four. +## Foundational mechanism decisions + +Use the [six bounded decision cases](references/foundational-mechanism-decisions.md) +to distinguish scheduling, caching/reuse and parallelism/pipelining after locating +a bottleneck. They route to existing domain owners and retain prerequisites, +counter-signals, smallest next checks and rollback boundaries. The cases are +candidate guidance, not an automatic method selector or new validation results. + ## Phase-locked optimization round An effective optimization round has locked phases that cannot be reordered. diff --git a/src/inferrsi/data/skill_library/methods/optimization-search-policy/metadata.json b/src/inferrsi/data/skill_library/methods/optimization-search-policy/metadata.json index 8d598948..0bd9f0a0 100644 --- a/src/inferrsi/data/skill_library/methods/optimization-search-policy/metadata.json +++ b/src/inferrsi/data/skill_library/methods/optimization-search-policy/metadata.json @@ -27,7 +27,8 @@ "references/papers-20261015/MECHANISMS.md", "references/papers-20261015/NEXT_GATE_LEADS.md", "references/papers-20261015/references/source-notes.md", - "references/papers-20261015/updates/optimization-search-policy.md" + "references/papers-20261015/updates/optimization-search-policy.md", + "references/foundational-mechanism-decisions.md" ], "references": [ "../inference-optimization-casebook/cases/qwen-b300-rejected-directions.md", @@ -35,7 +36,19 @@ "../inference-optimization-casebook/cases/qwen-ascend-rejected-directions.md", "../inference-optimization-casebook/cases/qwen-ascend-rejected-directions.json", "../inference-optimization-casebook/cases/drama3-rejected-directions.md", - "../inference-optimization-casebook/cases/drama3-rejected-directions.json" + "../inference-optimization-casebook/cases/drama3-rejected-directions.json", + "../performance-ceiling-analysis/SKILL.md", + "../assess-serving-preemption/SKILL.md", + "../assess-serving-preemption/references/source-notes.md", + "../../repositories/vllm/diagnose-vllm-admission-pressure/SKILL.md", + "../../repositories/vllm/diagnose-vllm-admission-pressure/references/source-notes.md", + "../../repositories/vllm/audit-vllm-kv-lifetimes/SKILL.md", + "../../repositories/vllm/audit-vllm-kv-lifetimes/references/source-notes.md", + "../../repositories/lmcache/kv-tier-management/SKILL.md", + "../choose-parallel-training-plan/SKILL.md", + "../choose-parallel-training-plan/references/source-notes.md", + "../../repositories/afd-plugin/audit-afd-p2p-exchanges/SKILL.md", + "../../repositories/afd-plugin/audit-afd-p2p-exchanges/references/source-notes.md" ], "consumption_mode": "packaged" } diff --git a/src/inferrsi/data/skill_library/methods/optimization-search-policy/references/foundational-mechanism-decisions.md b/src/inferrsi/data/skill_library/methods/optimization-search-policy/references/foundational-mechanism-decisions.md new file mode 100644 index 00000000..6ad78090 --- /dev/null +++ b/src/inferrsi/data/skill_library/methods/optimization-search-policy/references/foundational-mechanism-decisions.md @@ -0,0 +1,207 @@ +# Foundational mechanism decisions + +Status: candidate; empirical validation: **not_run**. This guide consolidates +existing packaged evidence for [issue #131](https://github.com/InferMatrixLab/InferRSI/issues/131). +It adds no primary-source inspection, selector, experiment result or permission +to change a system. Resource layers locate a bottleneck; scheduling, caching/reuse +and parallelism/pipelining describe possible interventions. They are not an +exhaustive taxonomy or a ranking of solutions. + +## Use the measured boundary + +Start with the fixed workload, useful work and quality/SLO contract, measured +limiting stage, resource budget, software revision and allowed changes. If these +are missing, defer the optimization choice and name the missing observation. +Use [performance-ceiling-analysis](../../performance-ceiling-analysis/SKILL.md) +for headroom and the parent search policy for experiment ordering and stopping. +A keyword or available recipe does not identify a cause. + +| Axis | Question before a candidate change | Preserve | +| --- | --- | --- | +| Scheduling | Who becomes eligible, in which order, at which boundary? | Progress, service order, fairness/backpressure and unfinished state | +| Caching / reuse | Which repeated work is avoided, with which identity and lifetime? | Validity, ownership, readiness, invalidation and eviction obligations | +| Parallelism / pipelining | Which independent work can occupy which stage or resource? | Dependencies, tensor/request identity, in-flight memory and completion | + +The cases below are **golden expectations for a human or agent to assess**, not +implemented dispatch rules. Collect matches identity/metadata/entrypoint text; it +does not diagnose bottlenecks or make semantic selection/abstention judgments. +CPU checks can validate retrieval, references and revision refusal, not that an +agent chose the appropriate method. + +## Scheduling + +### S1 — Admission gates before preemption + +- **Signal and prerequisite:** Waiting work coexists with low scheduled-token use + or allocation pressure. Identify which gate blocked the request before proposing + a larger batch, different ordering or preemption. +- **Source boundary:** The carried vLLM + [admission ledger F1–F5](../../../repositories/vllm/diagnose-vllm-admission-pressure/references/source-notes.md#f1--separate-budgets-and-admission-caps-implementation) + pins `7f730b4cea9a66520a9200265928ebe016b48a39`, supplied 2026-10-15. + Running/active caps, token/input budgets, readiness and allocation are separate. + Pending connector frees can stop allocation retries without immediate preemption; + counted remote-prefix tokens are not load readiness. +- **Candidate and invariants:** Route to + [diagnose-vllm-admission-pressure](../../../repositories/vllm/diagnose-vllm-admission-pressure/SKILL.md). + Change only the implicated gate while preserving token/state accounting, + blocked-request handling and the service contract. This readset does not + establish safe CLI values or behavior of a concrete connector. +- **Counter-signal:** No runnable work, an earlier gate, input/encoder waits or + pending frees can explain unused capacity. A queue alone does not identify a + policy bottleneck. +- **Next verification / rollback:** First trace the blocking branch and request + state at the current revision. For a later authorized contrast, match useful + work and measure queue/token latency and completion. Restore the prior + configuration if progress, protected-request latency or quality regresses. + +### S2 — Preemption must retain a recovery path + +- **Signal and prerequisite:** Heterogeneous jobs wait behind service while + unfinished requests retain KV. Establish supported resume, recompute or transfer + and count all started, unfinished state, not just running jobs. +- **Source boundary:** The carried + [Orca O1/O3 and FastServe F1–F3 notes](../../assess-serving-preemption/references/source-notes.md) + use Orca OSDI 2022 proceedings (§4.2/Algorithm 1) and FastServe + `2305.05920v3` (§§4.1–4.2), read 2026-10-15. Iteration eligibility and + conservative reservations differ from priority/promotion and suspended-state + residency. Historical paper mechanisms are not current vLLM APIs. +- **Candidate and invariants:** Use + [assess-serving-preemption](../../assess-serving-preemption/SKILL.md) to separate + admission, eligibility, service order and recovery. Less conservative admission + or changed order must preserve progress, state identity, recoverability, + backpressure and the declared fairness contract. +- **Counter-signal:** Long uninterruptible prefill, dominant engine time or exposed + copy/recompute can outweigh scheduling benefits. Aggregate tail improvement is + not per-tenant fairness; asynchronous copies do not establish useful overlap. +- **Next verification / rollback:** First inventory running and suspended KV and + recovery ownership. A later authorized contrast must retain cohort tails and + exposed recovery cost alongside throughput. Restore prior ordering/residency + if recovery stalls or protected classes regress. Do not adopt a paper threshold + as a tuning default. + +## Caching and reuse + +### C1 — Available KV is different from tier capacity + +- **Signal and prerequisite:** A reported hit/computed-token count coexists with + a blocked request, or retained/prefetched data pressures a lower tier. Identify + a validity/readiness/lifetime problem versus a capacity/retention problem. +- **Source boundary:** The carried + [vLLM KV ledger F1–F4/F6](../../../repositories/vllm/audit-vllm-kv-lifetimes/references/source-notes.md) + pins `7f730b4cea9a66520a9200265928ebe016b48a39`, supplied 2026-10-15. + Async counted tokens precede receive completion; connector retention and + scheduler in-flight-write fencing differ. Base-class obligations do not qualify + a concrete backend. Separately, + [LMCache MP tier management](../../../repositories/lmcache/kv-tier-management/SKILL.md) + retains historical prefix `c3b875a` (inspection date unrecorded here). + Its retention, staging and prefetch-pressure policy has a separate pin/scope. +- **Candidate and invariants:** First use + [audit-vllm-kv-lifetimes](../../../repositories/vllm/audit-vllm-kv-lifetimes/SKILL.md) + for hit identity, completion, failure and release ownership. Use the tier owner + only for an identified supported MP stack and measured retention/pressure + question. Preserve prefix validity and source/destination lifetime through + required completion; spare capacity does not satisfy a dependency. +- **Counter-signal:** Adding capacity does not repair a failed receive, stale + identity or held source block. Extra retention/prefetch can increase RAM + pressure; hit rate alone does not show lower request latency. vLLM lifecycle + evidence does not prove LMCache tier availability or a compatible dependency tuple. +- **Next verification / rollback:** Trace allocation, receive completion/failure + and deferred release at the selected implementation. A later authorized tier + contrast should measure useful contiguous-prefix reuse, resident/in-flight + bytes and request latency. Restore prior retention/prefetch if pressure or + protected latency worsens; never bypass readiness or free live buffers. + +### C2 — Graph reuse can lose to replay and copy cost + +- **Signal and prerequisite:** Repeated launch/setup work suggests graph or + compiled-artifact reuse. Establish stable capture boundaries, shapes, buffer + identity/lifetime, useful work and equivalent output. +- **Historical observation:** The + [Qwen B300 rejection case](../../inference-optimization-casebook/cases/qwen-b300-rejected-directions.md) + and [identity record](../../inference-optimization-casebook/cases/qwen-b300-rejected-directions.json) + retain InferRSI source `d51c941dc57807c1e16ea698cd9291f414110c45`, + issue #3. H6/H7 graph projection/norm/RoPE or post-attention trials were removed + for no material end-to-end gain; H7 separately records replay/copy costs. These + are carried historical observations in that Qwen/BF16/native-step/four-B300 + context, not experiments rerun here or a newly established common cause. +- **Candidate and invariants:** Revisit with a stated changed condition, such as + a supported capture boundary or buffer lifetime. Preserve work, graph-input + identity, numerical/image quality and valid buffer ownership. +- **Counter-signal:** Faster enqueue or a reusable artifact can coexist with no + full-request gain after capture, replay and copies. This record does not ban + graph reuse; the campaign's final PASS does not qualify H6/H7. +- **Next verification / rollback:** Inspect the rejection scope first. A later + authorized contrast must include capture amortization, replay/copies and + full-request cost under matched quality control. Restore the complete prior + launcher/configuration/artifact if quality fails or benefit is absent; retain + the new verdict separately from the historical result. + +## Parallelism and pipelining + +### P1 — Balance stages against communication and in-flight memory + +**Training only: this is not an inference-serving placement recipe.** + +- **Signal and prerequisite:** Stages have unequal work/memory and idle intervals. + Fix global batch, microbatch count, shapes, precision/optimizer state and topology + before changing stage boundaries, meshes or shardings. +- **Source boundary:** The packaged + [Alpa AL1–AL2 ledger](../../choose-parallel-training-plan/references/source-notes.md#al-alpa) + pins `2201.12023v3`, especially §§4–7, with the original readset/PDF digest. + This consolidation does not reread the paper or invent an inspection date. + Its objective omits inter-stage transfer, takes microbatch count externally and + does not optimize compute/communication overlap; the model is static training. +- **Candidate and invariants:** Route to + [choose-parallel-training-plan](../../choose-parallel-training-plan/SKILL.md). + Compare against a simple equal-stage incumbent using actual transfer and + per-rank peak memory, including in-flight activations/staging. Preserve training + semantics, batch/work and tensor partition identity. +- **Counter-signal:** Balanced modeled compute can expose communication or exhaust + activation memory. Equal-layer partitioning already matches the reported plan + on the tested homogeneous GPT case. Solver output is not a measured optimum. +- **Next verification / rollback:** First account for omitted transfer, topology + and memory feasibility. Later authorized training checks must establish + correctness, full-step benefit and planning amortization. Restore the prior + partition/launcher if quality, capacity or full-step cost regresses. Historical + evidence does not qualify a current GPU/NPU stack. + +### P2 — Preserve peer rows before seeking pipeline overlap + +- **Signal and prerequisite:** Attention/FFN separation creates an exchange + boundary. Establish role/native/communication ranks, layer/stage identity, + per-peer row lengths and receive-buffer ownership for the selected eager path. +- **Source boundary:** The + [AFD F1–F4 ledger](../../../repositories/afd-plugin/audit-afd-p2p-exchanges/references/source-notes.md#f1--derive-role-rank-then-communication-namespaces) + pins `df8d6a0c403c3ca1b4ed9cf1687e7204908bebec`, inspected 2026-10-23: + CUDA P2pNccl eager dense FFN with `compute_gate_on_attention=false`. + Control destination and data fan-in can differ; matching a total token count + does not preserve each peer's rows. +- **Candidate and invariants:** Use + [audit-afd-p2p-exchanges](../../../repositories/afd-plugin/audit-afd-p2p-exchanges/SKILL.md) + before proposing placement/overlap. Preserve per-peer lengths through + concatenation, FFN and return splitting, receive context and buffer lifetime. + Python return is not device/communication completion. +- **Counter-signal:** An even split, valid total shape or more in-flight work can + conceal ownership errors or extra staging. Source synchronization calls do not + prove overlap, successful rendezvous or a performance gain. +- **Next verification / rollback:** Trace producer-to-consumer rank/stage/row + ownership first. Native/model/transport checks need separate authorization and + a pinned dependency tuple; communicator internals and multi-host behavior remain + unqualified. Restore the prior supported topology and stage/buffer policy if + identity, completion or capacity cannot be established. Exclude MoE, graph/DBO + and NPU paths. + +## Evidence and authorization limits + +All six cases reuse canonical material packaged before this contribution. +Source notes retain attribution, license scope, versions and original inspection +dates; abbreviated historical pins remain prefixes. New primary inspection, +backend correctness, quality, performance and agent efficacy are **not_run**. +Missing Sarathi, PagedAttention or DistServe archives are not silently replaced +with a proposal bibliography. + +Keep each domain owner as the substantive procedure. These short cases provide a +reason to inspect it, reject/defer a candidate and choose a bounded next check. +They do not promote candidates or authorize execution, resource changes, +publication or integration. Preserve the last qualified incumbent and record +better/worse/inconclusive outcomes under the existing search policy. diff --git a/tests/test_foundational_mechanism_decisions.py b/tests/test_foundational_mechanism_decisions.py new file mode 100644 index 00000000..852d8dac --- /dev/null +++ b/tests/test_foundational_mechanism_decisions.py @@ -0,0 +1,137 @@ +import hashlib +from pathlib import Path + +import pytest + +from inferrsi.knowledge_operations import KnowledgeReader + +LIBRARY = Path(__file__).resolve().parents[1] / "src/inferrsi/data/skill_library" +GUIDE = "methods/optimization-search-policy/references/foundational-mechanism-decisions.md" + +# 这些 golden IDs 只检查 retrieval 合同,不模拟 method selector。 +CASES = [ + ( + "S1", + "diagnose-vllm-admission-pressure", + "skill", + "candidate", + "repositories/vllm/diagnose-vllm-admission-pressure/SKILL.md", + "inferrsi.common.skills.diagnose_vllm_admission_pressure", + ), + ( + "S2", + "assess-serving-preemption", + "skill", + "candidate", + "methods/assess-serving-preemption/SKILL.md", + "inferrsi.common.skills.assess_serving_preemption", + ), + ( + "C1", + "audit-vllm-kv-lifetimes", + "skill", + "candidate", + "repositories/vllm/audit-vllm-kv-lifetimes/SKILL.md", + "inferrsi.common.skills.audit_vllm_kv_lifetimes", + ), + ( + "C2", + "case.qwen-b300-rejected-directions", + "case", + "historical_observation", + "methods/inference-optimization-casebook/cases/qwen-b300-rejected-directions.md", + "inferrsi.common.skills.inference_optimization_casebook", + ), + ( + "P1", + "choose-parallel-training-plan", + "skill", + "candidate", + "methods/choose-parallel-training-plan/SKILL.md", + "inferrsi.common.skills.choose_parallel_training_plan", + ), + ( + "P2", + "audit-afd-p2p-exchanges", + "skill", + "candidate", + "repositories/afd-plugin/audit-afd-p2p-exchanges/SKILL.md", + "inferrsi.cuda.skills.audit_afd_p2p_exchanges", + ), +] + + +@pytest.fixture(scope="module") +def reader(): + reader = KnowledgeReader(skill_root=LIBRARY) + checkout = reader.read("checkout:optimization-search-policy") + package = reader.read("package:inferrsi.common.skills.optimization_search_policy") + assert checkout.metadata["state"] == "candidate" + assert checkout.metadata["empirical_validation"] == "not_run" + assert package.metadata["kind"] == "knowledge" + assert package.metadata["state"] == "imported" + assert checkout.dependencies + for reference in checkout.dependencies: + assert reference in checkout.content + for reference, key in ( + ("checkout:optimization-search-policy", GUIDE), + ( + "package:inferrsi.common.skills.optimization_search_policy", + "data/skill_library/" + GUIDE, + ), + ): + bundle = checkout if reference.startswith("checkout:") else package + data = reader.resource(reference, key, revision=bundle.revision) + assert data == (LIBRARY / GUIDE).read_bytes() + assert hashlib.sha256(data).hexdigest() == bundle.view()["resources"][key] + return reader + + +@pytest.mark.parametrize( + "case_id,identity,kind,state,path,package_id", CASES, ids=[case[0] for case in CASES] +) +def test_curated_owner_material_contract(reader, case_id, identity, kind, state, path, package_id): + reference = f"checkout:{identity}" + assert reference in reader.identities() + result = reader.collect(ids=[reference], kind=kind, material=True) + assert not result["no_match"] and not result["omissions"] + assert [item["ref"] for item in result["items"]] == [reference] + item = result["items"][0] + assert item["kind"] == kind + bundle = reader.read(reference, revision=item["revision"]) + view = bundle.view() + assert view["state"] == state + assert view["sources"] and view["applicability"] and view["limitations"] + key = Path(path).name if kind == "case" else path + data = reader.resource(reference, key, revision=item["revision"]) + assert data == bundle.content[key] == (LIBRARY / path).read_bytes() + assert hashlib.sha256(data).hexdigest() == view["resources"][key] + package_ref = f"package:{package_id}" + package = reader.read(package_ref) + package_key = "data/skill_library/" + path + assert reader.resource(package_ref, package_key, revision=package.revision) == data + assert package.view()["resources"][package_key] == hashlib.sha256(data).hexdigest() + if case_id == "C1": + tier = reader.read("checkout:kv-tier-management") + tier_key = "repositories/lmcache/kv-tier-management/SKILL.md" + assert tier.metadata["state"] == "candidate" + assert reader.resource( + "checkout:kv-tier-management", tier_key, revision=tier.revision + ) == (LIBRARY / tier_key).read_bytes() + + +def test_required_unavailable_revision_is_not_substituted(reader): + reference = "checkout:optimization-search-policy" + result = reader.collect( + ids=[reference], + revisions={reference: "sha256:" + "0" * 64}, + kind="skill", + material=True, + ) + assert result["no_match"] and result["items"] == [] + assert len(result["omissions"]) == 1 + omission = result["omissions"][0] + assert omission["id"] == reference + assert omission["reason"] == "unavailable_revision" + assert reference in omission["detail"] + assert "sha256:" + "0" * 64 in omission["detail"]