HuggingFaceBio/seqqa-reward-reference
SEQQA reward reference Regression fixture for trl.internal.seqqa.reward, used by tests/internal/test_seqqa_rewards.py. 39 hand-checked answers across 20 SEQQA validator types: for each the answer string, the ideal reference answer, and whether seqqa_accuracy_reward is expected to score it 1.0 (expected = true) or 0.0. validator_params_json is the serialised validator payload, and source_id / source_revision point at the generated question this row was pinned from. Values are… See the full description on the dataset page: https://huggingface.co/datasets/HuggingFaceBio/seqqa-reward-reference.
SEQQA reward reference
Regression fixture for trl.internal.seqqa.reward, used by tests/internal/test_seqqa_rewards.py.
39 hand-checked answers across 20 SEQQA validator types: for each the answer string, the ideal reference answer, and whether seqqa_accuracy_reward is expected to score it 1.0 (expected = true) or 0.0. validator_params_json is the serialised validator payload, and source_id / source_revision point at the generated question this row was pinned from.
Values are pinned to real generated questions, so regenerating them is not equivalent to editing this set; change a row only alongside the reward change that motivates it.