Skip to content

DecisionPolicy PR#346

Merged
laerdon merged 14 commits into
CornellNLP:masterfrom
laerdon:master
Jun 15, 2026
Merged

DecisionPolicy PR#346
laerdon merged 14 commits into
CornellNLP:masterfrom
laerdon:master

Conversation

@laerdon

@laerdon laerdon commented Apr 28, 2026

Copy link
Copy Markdown
Contributor

This PR is meant to introduce decision policies as a flexible layer for turning model scores into final intervention decisions.

Instead of each forecaster handling its own threshold tuning logic, these changes move that work into the shared DecisionPolicy base class.

We also provide an implementation of a deferral-oriented policy that can look at simulated future replies before deciding whether to intervene.

Update:
More recent commits introduce some extra changes:

  • Adding in other decision policies, including the RandomDeferral, SimulationAverage, and SimulationMajority decision policies.
  • Edited the notebook decisionpolicy_demo.ipynb to further anonymize data, and added section headings.
  • Edited docstrings which had not been fully updated.
  • Excised unnecessary code in DeferralDecisionPolicy.
  • Black reformatting.

Update 6/8:

  • Fixed update in init with adding more decision policies
  • Added decisionpolicy rst for docs
  • Cleaned errant TODO in TransformerDecoderModel.py

Update 6/12:

  • Checked package dependencies
  • Added link to arXiv in decisionpolicy.rst
  • Cleaned TODO from demos (got rid of local loaders)

laerdon and others added 5 commits April 1, 2026 12:23
* refactor forecaster model to use decision policies

Co-authored-by: Laerdon Kim <laerdon@users.noreply.github.com>

* update forecaster models for score and policy orchestration

Co-authored-by: Laerdon Kim <laerdon@users.noreply.github.com>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Laerdon Kim <laerdon@users.noreply.github.com>
@laerdon laerdon marked this pull request as ready for review May 1, 2026 03:15
@laerdon laerdon requested a review from vianxnguyen May 1, 2026 18:18
@laerdon laerdon closed this May 25, 2026
@laerdon laerdon reopened this May 25, 2026
@laerdon laerdon merged commit 2767ed5 into CornellNLP:master Jun 15, 2026
4 of 10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant