Repository navigation
Move corpus add/validate/extract tooling into the corpus repo - #1
Merged
Merged
Conversation
The MANIFEST header referenced README.md, the validate-corpus CI check, and the PDF extraction script/workflow, but those only existed in GenAI-Security-Advisor, where the corpus was originally built. Bring them here so adding and processing resources happens in this repo: - scripts/validate_corpus.py, extract_pdf_text.py, requirements.txt - .github/workflows/validate-corpus.yaml (PR check) and extract-pdf-text.yaml (regenerates corpus/_extracted/ on main) - README.md with the add/update process, CONTRIBUTING.md, CODEOWNERS, LICENSE (Apache-2.0 for repo-native files), .gitignore - MANIFEST header now points at README.md and names both consumers Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_015bzez2N6vdSh6qXV7Y44P9
The Advisor skill's corpus/ is a copy made by a GitHub Action; make that explicit so corpus edits land here rather than in the skills repo. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_015bzez2N6vdSh6qXV7Y44P9
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Makes this repo the authoritative, self-contained place to add, validate, and process corpus resources, for both the Advisor skill and the MCP server.
The MANIFEST header referenced README.md, a validate-corpus CI check, and the PDF extraction script/workflow, but those only existed in GenAI-Security-Advisor, where the corpus was first built. This brings them over:
scripts/validate_corpus.py,scripts/extract_pdf_text.py,scripts/requirements.txt(copied unchanged).github/workflows/validate-corpus.yaml(PR check) andextract-pdf-text.yaml(regeneratescorpus/_extracted/on push to main)README.mdwith the add/update process,CONTRIBUTING.md,CODEOWNERS,LICENSE(Apache-2.0 for repo-native files),.gitignorecorpus/is a copy made by a GitHub Action and should not be edited directlyTested locally: the validator passes on all 19 entries; extraction runs on all 13 PDFs.
pypdfis unpinned, so the first extraction run after merge may rewrap the existing_extracted/text.Generated by Claude Code