AlignmentResearch/probe-inference-parity

probe-inference parity fixture Test fixture for the probe-inference package's parity tests (tests/test_parity.py). The tests download this dataset at a pinned revision and check that the package reproduces reference scores on real activations. For each model it holds a few rows of residual-stream activations and token masks, and the reference score of each probe on each row. It holds no probes: the tests load them from AlignmentResearch/probe-inference-weights at the package's… See the full description on the dataset page: https://huggingface.co/datasets/AlignmentResearch/probe-inference-parity.