pietrolesci/pile-validation
This dataset has been created as an artefact of the paper Causal Estimation of Memorisation Profiles (Lesci et al., 2024). More info about this dataset in the related collection Memorisation-Profiles. The validation data used in our study. The Pythia suite does not have an official validation. However, we confirmed with the authors that the Pile validation split (this one) was not seen during training. It is still a bit confusing whether the Pile data can be released freely. Thus, we will… See the full description on the dataset page: https://huggingface.co/datasets/pietrolesci/pile-validation.
This dataset has been created as an artefact of the paper Causal Estimation of Memorisation Profiles (Lesci et al., 2024). More info about this dataset in the related collection Memorisation-Profiles.
The validation data used in our study. The Pythia suite does not have an official validation. However, we confirmed with the authors that the Pile validation split (this one) was not seen during training. It is still a bit confusing whether the Pile data can be released freely. Thus, we will remove this dataset if required.