Team Ai
Datasetpublic

bigcode/commitpack-subset-cf

A subset of CommitPack used for pretraining SantaCoderPack from the OctoPack paper. It focuses on data where the code before + special token + code after fits into 8192 tokens and on 6 languages. The data is in commit format (cf): <commit_before>code_before<commit_message>commit_message<commit_after>code_after.

sourceHugging Faceupdated 3y agoView on Hugging Face
2likes2.4kdownloads
../

bigcode/commitpack-subset-cf ยท main ยท files are served by the source, never re-hosted here