evaluation-dataset

Here are 3 public repositories matching this topic...

dataanswer / awesome-agent-benchmarks

A curated collection of the world’s most advanced benchmark datasets for evaluating Large Language Model (LLM) Agents.

agent benchmarks awesome-list agent-based-modeling awesome-list-awesome-list ai-agent llm-agent llm-evaluation llm-agents agentic-ai guiagents agent-benchmark evaluation-dataset

Updated Dec 21, 2025

axxafo / awesome-agent-benchmarks

Star

🧠 Discover and evaluate advanced benchmark datasets for Large Language Model agents to enhance performance assessment in real-world tasks.

search awesome ai benchmarks rl agent-based-modeling reasoning awesome-list-awesome-list ai-models ai-agent for-devs llm-agent agentic llm-evaluation llm-agents agentic-ai guiagents agent-benchmark evaluation-dataset

Updated Aug 5, 2026

anbsamsam17 / Eval-dataset-generator

Star

Turns raw production logs into a labeled, deduplicated, statistically validated eval dataset. Human-vs-judge agreement measured double-blind (Cohen's κ + bootstrap CI95): a first run blocked at κ=0.26, drove a guideline fix, then cleared at κ=0.80 on the target domain. Honest dedup, HDBSCAN coverage, sha256 provenance, 677 offline tests.

python reproducibility deduplication cohens-kappa inter-rater-agreement hdbscan stratified-sampling data-provenance pydantic pii-redaction anthropic llm-evaluation llm-as-a-judge evaluation-dataset

Updated Aug 5, 2026
Python

Improve this page

Add a description, image, and links to the evaluation-dataset topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the evaluation-dataset topic, visit your repo's landing page and select "manage topics."

Learn more