Skip to content

Add four general assistant benchmark papers#36

Merged
estelledc merged 1 commit into
mainfrom
study/papers-20260715-general-assistant-round
Jul 15, 2026
Merged

Add four general assistant benchmark papers#36
estelledc merged 1 commit into
mainfrom
study/papers-20260715-general-assistant-round

Conversation

@estelledc

Copy link
Copy Markdown
Owner

Summary

  • summarize the prior web/app/tool-use round gaps and add four study-v2 notes for general assistant, time-consuming web tasks, browser evaluation infrastructure, and mobile GUI agents
  • add GAIA, AssistantBench, BrowserGym, and AndroidWorld paper notes
  • add matching study-review-receipt-v1 files with STATIC_ANALYSIS / UNVERIFIED evidence boundaries
  • refresh papers atlas, note index, public count copy, and SESSION-HANDOFF

Verification

  • lr search arxiv + arXiv API metadata checks for all four papers
  • node scripts/quality-gate.mjs for each new note: pass, no advisories
  • npm run audit:content-contract
  • npm run atlas
  • npm run audit:counts
  • npm run audit:links
  • npm run audit:wikilinks
  • git ls-files -co --exclude-standard -z | node scripts/audit-public-redlines.mjs --stdin0
  • npm run build:strict -- --log /tmp/study-20260715-general-assistant-round-build-clean.log
  • STUDY_CHANGED_FROM=origin/main npm run verify:ci

Evidence boundary

All four notes remain STATIC_ANALYSIS / UNVERIFIED. No GAIA, AssistantBench, BrowserGym, or AndroidWorld benchmark environment was executed.

@estelledc estelledc merged commit 41e0c66 into main Jul 15, 2026
1 check passed
@estelledc estelledc deleted the study/papers-20260715-general-assistant-round branch July 15, 2026 02:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant