AdaptiveChunking/hnet-chunking-probes

H-Net chunker boundary probes Longitudinal boundary decisions for 31 H-Net runs, logged on a fixed, byte-identical FLORES+ probe at every checkpoint. This is the raw material for studying when a learned segmentation stabilises. Layout <run>/{step:06d}__{lang}.npz, plus <run>/probe_text.jsonl (the raw probe text, so byte offsets can be aligned to external gold data). 40 log-spaced steps: 0, 1, 2, 4, 8, 16, 32, 64, 128, 200, then every 200 to 6000. The early… See the full description on the dataset page: https://huggingface.co/datasets/AdaptiveChunking/hnet-chunking-probes.