WorkBuddy Bench
WorkBuddy Bench is a multi-domain evaluation suite designed to test coding agents on realistic, complex tasks across software engineering, web development, office workflows, and security. It features 260 contamination-resistant tasks reverse-engineered from real-world commits and business scenarios to ensure agents are evaluated on genuine problem-solving capabilities rather than memorized data.
WorkBuddy Bench is a multi-domain evaluation suite designed to test coding agents on realistic, complex tasks across software engineering, web development, office workflows, and security. It features 260 contamination-resistant tasks reverse-engineered from real-world commits and business scenarios to ensure agents are evaluated on genuine problem-solving capabilities rather than memorized data.
- 01260 contamination-resistant tasks across Code, Web, Office, and Security domains
- 02Tasks reverse-engineered from real-world commits, PRs, and business scenarios
- 03Unified task-directory format with sandboxed Dockerized environments
- 04Reproducible evaluation protocol compatible with CodeBuddy Code and Claude Code harnesses
- 05Transparent and auditable open-source release including test cases and reference solutions