Merge branch 'feature/validate-exceptions'

Author: beachdweller

.github/workflows/build.yml

@@ -42,6 +42,7 @@ jobs:
         api-key: ${{ secrets.GOOGLE_API_KEY }}
         readme-path: tests/sample_readme.md
         explanation-in: Korean
+        fail-expected: True
       timeout-minutes: 5
 
     - name: Output the outputs of the integration test of the action

CHANGELOG.md

@@ -9,6 +9,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 ### Added
 * MECE principle in comment generation
 * if failed, assert the error message
+* fail-expected argument to fail the test if the expected fail count not correct
 
 
 ### Changed

entrypoint.py

@@ -33,6 +33,8 @@ def main() -> None:
 
     explanation_in = os.environ['INPUT_EXPLANATION-IN']
 
+    b_fail_expected = ('true' == os.getenv('INPUT_FAIL-EXPECTED', 'false').lower())
+
     n_failed, feedback = ai_tutor.gemini_qna(
         report_files,
         student_files,
@@ -48,7 +50,12 @@ def main() -> None:
         out_string = f'feedback<<EOF\n{feedback}\nEOF'
         logging.info(f"Writing to GITHUB_OUTPUT: {f.write(out_string)} characters")
 
-    assert n_failed == 0, f'{n_failed} failed tests'
+    if not b_fail_expected:
+        assert n_failed == 0, f'{n_failed} failed tests'
+    elif b_fail_expected:
+        assert n_failed > 0, 'No failed tests'
+    else:
+        raise NotImplementedError('Unexpected value for INPUT_FAIL-EXPECTED')    
 
 
 def get_path_tuple(report_files_str:str) -> Tuple[pathlib.Path]: