cpg
Datasets
All datasets matching “cpg”rat-benchThis dataset was generated for RAT-Bench, a comprehensive, multilingual benchmark for evaluating text anonymization tools.
Github repo containing evaluation code & instructions;
Leaderboard with rankings for existing tools;
Paper containing benchmark construction details, experimental setup, and extensive results.
Dataset contents
This repository contains benchmark data in three languages:
english
serbian
spanish
dutch
Each language directory contains .json files named in… See the full description on the dataset page: https://huggingface.co/datasets/imperial-cpg/rat-bench.cpgendatacopyright-traps
Copyright Traps
Copyright traps (see Meeus et al. (ICML 2024)) are unique, synthetically generated sequences
who have been included into the training dataset of CroissantLLM.
This dataset allows for the evaluation of Membership Inference Attacks (MIAs) using CroissantLLM as target model,
where the goal is to infer whether a certain trap sequence was either included in or excluded from the training data.
This dataset contains non-member (label=0) and member (label=1) trap… See the full description on the dataset page: https://huggingface.co/datasets/imperial-cpg/copyright-traps.project-gutenberg-extended
Books from Project Gutenberg (after PG-19)
This dataset contains 9,542 books collected from Project Gutenberg, an online library for free e-books.
Specifically, we collect books that have been added to Project Gutenberg after the last book
that has been included in the widely used PG-19 dataset. Of all books included in PG-19, the
latest release date on Project Gutenberg was February 10, 2019. We use an open source library to
download all English books that were added to Project… See the full description on the dataset page: https://huggingface.co/datasets/imperial-cpg/project-gutenberg-extended.datasets-srccpgQA-DE
Dataset Card for cpgQA-DE
cpgQA-DE is a German benchmark for evaluating whether medical question-answering systems can answer questions grounded in German Clinical Practice Guidelines (CPGs).
Evaluation only. Do not use for training.
This is a research benchmark, not a clinical decision-support tool.
Dataset Details
This repository provides four evaluation files.
cpgQA_DE_main.json
Contains 200 validated guideline-based questions with answer keys… See the full description on the dataset page: https://huggingface.co/datasets/MedInf-AI/cpgQA-DE.