Apppublic

JetBrains-Research/commit-labeling

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes

data_loader.py17 linesDownload Raw Back to root

1import os2 3from datasets import load_dataset4 5HF_TOKEN = os.environ.get('HF_TOKEN')6 7MESSAGE_COLS = ['reference', 'prediction', 'enhanced']8 9CACHE_DIR = 'cache'10 11 12def load_data():13    return load_dataset("JetBrains-Research/commit-labeling-samples",14                        split="train",15                        cache_dir=CACHE_DIR,16                        token=HF_TOKEN).to_pandas().to_dict("records"), MESSAGE_COLS17