Datasetpublic

LemonTea03/BinaryOPD-Data

Do We Really Need KL Divergence for On-Policy Distillation of Large Language Models? This dataset supports the paper Do We Really Need KL Divergence for On-Policy Distillation of Large Language Models?. It contains training and evaluation data for on-policy distillation (OPD) experiments, including BinaryOPD, positive/negative reward experiments, and consensus multi-teacher on-policy distillation (C-MOPD). Code and additional details are available in the GitHub repository.… See the full description on the dataset page: https://huggingface.co/datasets/LemonTea03/BinaryOPD-Data.

sourceHugging Faceupdated 8d agoView on Hugging Face

0likes200downloads

settings

This repository belongs to LemonTea03 on Hugging Face.

Team Ai never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

nameBinaryOPD-Data

visibilitypublic

licencenot set

gatedno

ownerLemonTea03

Account settings