Skip to content

feat/Add OpenReward hosted env execution path-- OpenRewards PR 3/3#701

Draft
AmyTao wants to merge 1 commit into
benchflow-ai:v0.5-integrationfrom
AmyTao:port-pr-684-to-v05
Draft

feat/Add OpenReward hosted env execution path-- OpenRewards PR 3/3#701
AmyTao wants to merge 1 commit into
benchflow-ai:v0.5-integrationfrom
AmyTao:port-pr-684-to-v05

Conversation

@AmyTao

@AmyTao AmyTao commented Jun 12, 2026

Copy link
Copy Markdown
Contributor

Summary

This draft PR brings the OpenReward hosted-environment work into the v0.5-integration line.

It was prepared from the local port-pr-684-to-v05 branch, using v0.5-integration as the integration base and cherry-picking/adapting the relevant OpenReward hosted-env changes from release/v0.6.0.

What changed

  • Added OpenReward as a first-class hosted environment execution path.
  • Added OpenReward metadata/model-policy wiring for OpenAI Responses tool calls.
  • Added OpenReward rollout recording so runs appear in the OpenReward runs UI.
  • Added local rollout artifact metadata at artifacts/openreward_rollout.json.
  • Added hosted-env reward event helpers and ORS/OpenReward adapter plumbing.
  • Added trajectory redaction coverage and hosted-env artifact contract tests.
  • Added the openreward dependency and updated the lockfile.

Validation

  • uv run pytest tests/test_openreward_env.py -q
    • 16 passed
  • uv run pytest tests/test_openreward_env.py tests/test_hosted_env.py tests/test_hosted_env_rollout_contract.py tests/test_adapters.py tests/test_trajectory_redaction.py -q
    • 74 passed
  • uv run ruff check src/benchflow/openreward_env.py tests/test_openreward_env.py
    • All checks passed!
  • End-to-end OpenReward smoke test:
uv run bench eval create \
  --source-env openreward:GeneralReasoning/CTF \
  --source-env-arg split=train \
  --source-env-arg index=0 \
  --model gpt-5.4-mini \
  --jobs-dir /private/tmp/benchflow-openreward-pr3

Result:
Screenshot 2026-06-13 at 00 16 31
Screenshot 2026-06-13 at 00 16 38
Screenshot 2026-06-13 at 00 16 43

@AmyTao AmyTao changed the title Add OpenReward hosted env execution path to v0.5 integration feat/Add OpenReward hosted env execution path-- OpenRewards PR 3/3 Jun 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant