Skip to content

Bound command-syntax recovery and pivot after repeated invalid calls #32

Description

@justsml

Parent

#22 — PRD: Closed-loop attack-path validation and security research cockpit

What to build

Make command-syntax recovery converge. After an invalid shell/search shape, the controller should expose the exact validation error, permit at most one materially different correction, and then pivot to another approved tool or stop with a clear blocker. Repeated malformed calls must not consume the run budget or create fake execution evidence.

The DeepSeek V4 Flash hosted matrix recorded 2 syntax errors and 1 repeated similar mistake in command-syntax-recovery; the GPT OSS 120B control still recorded one syntax correction.

Acceptance criteria

  • Invalid command payloads are classified before execution and persisted as invalid attempts.
  • The recovery policy allows at most one materially different correction per error class before pivot/stop.
  • Three-repeat DeepSeek V4 Flash and GPT OSS 120B runs produce no repeated syntax mistake and at most one syntax error per scenario.
  • The final summary distinguishes invalid attempts, successful tool calls, and the remaining blocker with toolCalls/maxToolCalls.

Blocked by

None - can start immediately.

Metadata

Metadata

Assignees

No one assigned

    Labels

    ready-for-agentReady for an implementation agent

    Projects

    Status
    Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions