chore: Reduce CI execution time by changing some tests to use InProcessToolchain#3126
Open
filzrev wants to merge 1 commit into
Open
chore: Reduce CI execution time by changing some tests to use InProcessToolchain#3126filzrev wants to merge 1 commit into
filzrev wants to merge 1 commit into
Conversation
filzrev
commented
May 12, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR intended to reduce CI execution time by using
InProcessToolchainwhen possible.What's changed in this PR
1. Add shared configs to
TestConfigs.csAdd following test configs that used for faster test execution.
2. Add
Helpers/CaptureConsoleHelper.csThis helper class is used to capture console logs that are outputted by benchmark.
It's required because
StandardOutputis not recorded to Summary/Report instance. when running benchmark withInProcessToolchain.As a side effect, captured log contains benchmark execution logs also.
Though, It's not affects test results when assert contents line by line.
3. Modify some test code to use
InProcessToolchainModify following tests to use
SingleRunInProcessConfigwhen possible4. Modify some test code to use
SingleRunOutOfProcessConfigSome
BenchmarkSwitcherTesttests can't convert to useInProcessToolchainby following reason.[DryJob]attribute.--jobcommand line argument.--resumeoption (It seems not works because InProcessToolchain don't output logs for resume)So these test need to use
SingleRunOutOfProcessConfiginstead. (It's basically same behavior as original code)