docs(ai): add test-placement skill for the plugin testing strategy (RHIDP-13501)#5045
Closed
gustavolira wants to merge 2 commits into
Closed
docs(ai): add test-placement skill for the plugin testing strategy (RHIDP-13501)#5045gustavolira wants to merge 2 commits into
gustavolira wants to merge 2 commits into
Conversation
… ecosystem Adds an AI-assistant skill that, given the context of a change or bug, proposes the right repository (rhdh-plugins / rhdh-plugin-export-overlays / rhdh), the right test layer (L1 unit -> L4b cluster e2e), the location, and how to scaffold the test. Encodes the per-repo testing responsibility split consolidated on epic RHIDP-13501 (decision table, capability ladder, known-impossible list) so the cheapest environment that catches the bug is picked by default. Source in .rulesync/skills; .claude/.cursor/.opencode generated via rulesync 7.30.0. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #5045 +/- ##
==========================================
- Coverage 55.39% 54.77% -0.62%
==========================================
Files 122 110 -12
Lines 2365 2147 -218
Branches 544 518 -26
==========================================
- Hits 1310 1176 -134
+ Misses 1049 970 -79
+ Partials 6 1 -5
Continue to review full report in Codecov by Harness.
🚀 New features to boost your workflow:
|
…tion, path prefixes - Mark harnesses that are still in review and instruct the assistant to verify paths exist on main before recommending them (the skill referenced redhat-developer#5005/redhat-developer#5044/redhat-developer#2714/redhat-developer#4967 deliverables in present tense). - Describe the overlays native smoke's real interface: yarn smoke --dynamic-plugins <file> [--out] (no --workspace flag exists; the harness does not read workspaces/*/metadata — a workspace run is a dp.yaml listing its oci:// refs). - Replace the fork-only RHIDP-13235-layer3-component-tests branch pointer with the closed PR rhdh#4864. - Prefix every path with its repo (rhdh:/overlays:/plugins:) and use full URLs for cross-repo docs, so the skill resolves from any of its three homes. - Fix skopeo claim: it installs on macOS via brew; CI has it preinstalled. - Name the Docker smoke location (overlays smoke-tests/ + run-workspace-smoke-tests.yaml), replace the vague "any" repo cell, use "n/a (cluster)" for the cluster row's Docker column, move PR numbers to References with status, add trigger phrases to the frontmatter description, and deduplicate the guiding-rule sentence. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Contributor
|
The container image build workflow finished with status: |
|
Member
Author
|
Closing in favor of the centralized version in redhat-developer/rhdh-skill#58 — per review feedback on overlays#2726, the skill covers the whole RHDH ecosystem (three repos, five test layers), so it belongs in rhdh-skill rather than duplicated per-repo. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a
test-placementAI-assistant skill (Claude Code / Cursor / OpenCode, generated via rulesync): when a developer asks "where should I test this?", the assistant gathers the context and proposes the right repo (rhdh-plugins/rhdh-plugin-export-overlays/rhdh), the right layer (L1 unit → L4b cluster e2e), the location, and how to scaffold the test.It encodes the per-repository testing responsibility split consolidated on epic RHIDP-13501 (and its attached
rhdh-dynamic-plugin-testing-guideline.md):A sibling PR adds the same skill to
rhdh-pluginsandrhdh-plugin-export-overlays(.claude/skills/), so the guidance is available wherever the developer is working.Notes
docs/e2e-tests/layer-migration-matrix.md(docs(e2e): add E2E layer migration matrix (RHIDP-15076) #5044) anddocs/e2e-tests/local-e2e-harness.md(feat(e2e): cluster-free local E2E harness #5005) — both in review; the skill is accurate regardless of landing order..claude/.cursor/.opencodecopies generated withrulesync generate(7.30.0); the rulesync-check workflow should pass.Related
Epic RHIDP-13501 · Harness #5005 (RHIDP-15075) · Matrix #5044 (RHIDP-15076) · Sanity #4967 · Overlays native smoke rhdh-plugin-export-overlays#2714
🤖 Generated with Claude Code