Team Ai
Datasetpublic

ToiTenBao/hallucination-evaluation-results

Hallucination evaluation artifacts Canonical COCO and AMBER detection packages are under detection/<dataset>/models/<model>/probes/<probe>/. See detection/index.json for active and pending packages. Each published package has a manifest with exact checkpoint, cache and test-result paths. Seeds are 0, 42 and 1337. TruthPrInt retains its native validation TPR-at-1%-FPR checkpoint; other detection probes use best pooled validation AUROC. Detection thresholds are validation-best F1.… See the full description on the dataset page: https://huggingface.co/datasets/ToiTenBao/hallucination-evaluation-results.

sourceHugging Faceupdated 13h agoView on Hugging Face
0likes1.7kdownloads
Dataset Card

Hallucination evaluation artifacts

Canonical COCO and AMBER detection packages are under detection/<dataset>/models/<model>/probes/<probe>/. See detection/index.json for active and pending packages. Each published package has a manifest with exact checkpoint, cache and test-result paths. Seeds are 0, 42 and 1337. TruthPrInt retains its native validation TPR-at-1%-FPR checkpoint; other detection probes use best pooled validation AUROC. Detection thresholds are validation-best F1.

COCO and AMBER are independent training/evaluation datasets. COCO 13B Ours/VIB checkpoints, caches and results are copied here; their frozen source records are not yet published, so these two packages remain pending in the index.

ablation/ contains separately indexed detection ablations; it is not part of the main detection table. evaluation/ and sweeps/ are separate training-free evaluation artifacts and are not detection checkpoints. The old COCO/AMBER detection roots were removed from the current tree after staging and verification. The pre-migration revision f815f65101c828c95f69d221b4818cf977d3a991 remains available for recovery.

ToiTenBao/hallucination-evaluation-results · Team Ai