SamuelChien821/devopsbench-100
DevOpsBench-100 DevOpsBench-100 is a synthetic long-horizon software-engineering / SRE agent benchmark: 100 tasks over one executable world ("NovaCart", a mid-size e-commerce SaaS) with 72 SQLite tables, 1451 seeded rows, a 38-file monorepo with 417 commits, and 97 MCP tools spanning a first-party engineering stack (tickets, PRs, CI, deployments, canaries, migrations, feature flags, metrics, alerts, incidents, chat, knowledge base) plus deliberately disagreeing vendor-shaped… See the full description on the dataset page: https://huggingface.co/datasets/SamuelChien821/devopsbench-100.
Publish DevOpsBench-100 v3.2.7
Publish DevOpsBench-100 v3.2.6 human-request release
Publish DevOpsBench-100 v3.2.5 structural-diversity release (part 10)
Publish DevOpsBench-100 v3.2.5 structural-diversity release (part 9)
Publish DevOpsBench-100 v3.2.5 structural-diversity release (part 8)
Publish DevOpsBench-100 v3.2.5 structural-diversity release (part 7)
Publish DevOpsBench-100 v3.2.5 structural-diversity release (part 6)
Publish DevOpsBench-100 v3.2.5 structural-diversity release (part 5)
Publish DevOpsBench-100 v3.2.5 structural-diversity release (part 4)
Publish DevOpsBench-100 v3.2.5 structural-diversity release (part 3)
Publish DevOpsBench-100 v3.2.5 structural-diversity release (part 2)
Publish DevOpsBench-100 v3.2.5 structural-diversity release
Publish DevOpsBench-100 v3.2.4 realism release (part 23)
Publish DevOpsBench-100 v3.2.4 realism release (part 22)
Publish DevOpsBench-100 v3.2.4 realism release (part 21)
Publish DevOpsBench-100 v3.2.4 realism release (part 20)
Publish DevOpsBench-100 v3.2.4 realism release (part 19)
Publish DevOpsBench-100 v3.2.4 realism release (part 18)
Publish DevOpsBench-100 v3.2.4 realism release (part 17)
Publish DevOpsBench-100 v3.2.4 realism release (part 16)
Publish DevOpsBench-100 v3.2.4 realism release (part 15)
Publish DevOpsBench-100 v3.2.4 realism release (part 14)
Publish DevOpsBench-100 v3.2.4 realism release (part 13)
Publish DevOpsBench-100 v3.2.4 realism release (part 12)
Publish DevOpsBench-100 v3.2.4 realism release (part 11)
Publish DevOpsBench-100 v3.2.4 realism release (part 10)
Publish DevOpsBench-100 v3.2.4 realism release (part 9)
Publish DevOpsBench-100 v3.2.4 realism release (part 8)
Publish DevOpsBench-100 v3.2.4 realism release (part 7)
Publish DevOpsBench-100 v3.2.4 realism release (part 6)
Publish DevOpsBench-100 v3.2.4 realism release (part 5)
Publish DevOpsBench-100 v3.2.4 realism release (part 4)
Publish DevOpsBench-100 v3.2.4 realism release (part 3)
Publish DevOpsBench-100 v3.2.4 realism release (part 2)
Publish DevOpsBench-100 v3.2.4 realism release
Publish deterministic DevOpsBench-100 v3 release
DevOpsBench-100 v3.0.0 realism release
Add the near-duplicate release gate
Publish shared benchmark realism standard
Remove harness language from v2 requests (part 4)
Remove harness language from v2 requests (part 3)
Remove harness language from v2 requests (part 2)
Remove harness language from v2 requests
Publish devopsbench-100 v2 realism release (part 6)
Publish devopsbench-100 v2 realism release (part 5)
Publish devopsbench-100 v2 realism release (part 4)
Publish devopsbench-100 v2 realism release (part 3)
Publish devopsbench-100 v2 realism release (part 2)
Publish devopsbench-100 v2 realism release
Upload folder using huggingface_hub (part 2)