LocalLLaMA/typed-decisions

Typed Decisions A benchmark for typed probabilistic decisions. A model gets one piece of unstructured state and answers five typed questions about it at once, and every answer is a probability distribution, not a single label. The schema follows the System One primitives (noul, choice, score) used by TypeSafe AI, so a row replays against any API with that shape. The benchmark is independent: it is not affiliated with TypeSafe and does not reproduce their Jev model.… See the full description on the dataset page: https://huggingface.co/datasets/LocalLLaMA/typed-decisions.