SamuelChien821/semikongbench-100
SemiKongBench-100 One hundred independently authored synthetic semiconductor operations tasks: ten workflows across ten frozen fabs. Each task includes 20 agent-visible assets, a task-local SQLite world, 38 provider-shaped tools, an oracle trajectory, before/after snapshots, and a deterministic 100-point verifier. The model leaderboard is intentionally empty until a complete version-pinned 100-task model run exists. Release qualification executes oracle, replay, and six… See the full description on the dataset page: https://huggingface.co/datasets/SamuelChien821/semikongbench-100.
SemiKongBench-100
One hundred independently authored synthetic semiconductor operations tasks: ten workflows across ten frozen fabs. Each task includes 20 agent-visible assets, a task-local SQLite world, 38 provider-shaped tools, an oracle trajectory, before/after snapshots, and a deterministic 100-point verifier.
The model leaderboard is intentionally empty until a complete version-pinned 100-task model run exists. Release qualification executes oracle, replay, and six negative-control policies; controls are not model results.
Provenance and relationship to SemiKong
https://github.com/aitomatic/semikong and the SemiKong paper are public design anchors. This benchmark is not produced by, endorsed by, or an official scorecard of Aitomatic, SemiKong, or the AI Alliance. No SemiKong training/evaluation corpus or model weights are redistributed. Every task, value, file, tool, answer, and trajectory here is new synthetic content from Blobfish AI.
Dataset content is CC BY 4.0. Executable code is Apache-2.0 in the source repository.