Team Ai
Datasetpublic

SamuelChien821/devopsbench-100

DevOpsBench-100 DevOpsBench-100 is a synthetic long-horizon software-engineering / SRE agent benchmark: 100 tasks over one executable world ("NovaCart", a mid-size e-commerce SaaS) with 72 SQLite tables, 1451 seeded rows, a 38-file monorepo with 417 commits, and 97 MCP tools spanning a first-party engineering stack (tickets, PRs, CI, deployments, canaries, migrations, feature flags, metrics, alerts, incidents, chat, knowledge base) plus deliberately disagreeing vendor-shaped… See the full description on the dataset page: https://huggingface.co/datasets/SamuelChien821/devopsbench-100.

sourceHugging Facecc-by-4.0updated 1mo agoView on Hugging Face
0likes2.5kdownloads
11-source-inventory.csv8 linesDownload Raw Back to dob100-033-impl-chunk
1case_id,source,status
2DOB-033,Jira,inspect
3DOB-033,GitHub,inspect
4DOB-033,Confluence,inspect
5DOB-033,Slack,inspect
6DOB-033,PagerDuty,inspect
7DOB-033,live service,inspect
8