jean-technologies/user-simulation-requests
User simulation leaderboard: requests One file per submitted system, under <org>/<system>_eval_request_*.json, written by the leaderboard Space's submission form. status is PENDING when submitted, FINISHED once Jean has rerun the system against the frozen benchmarks. artifact records what Jean was given to rerun (open weights, a container or script, an API endpoint, or nothing, in which case the entry is listed as reported and is never ranked above a rerun row). verification… See the full description on the dataset page: https://huggingface.co/datasets/jean-technologies/user-simulation-requests.
User simulation leaderboard: requests
One file per submitted system, under <org>/<system>_eval_request_*.json, written by the leaderboard Space's submission form.
status is PENDING when submitted, FINISHED once Jean has rerun the system against the frozen benchmarks. artifact records what Jean was given to rerun (open weights, a container or script, an API endpoint, or nothing, in which case the entry is listed as reported and is never ranked above a rerun row). verification mirrors the leaderboard's levels.
Results are sent to the submitter, with protocol and rows, before they are published.