bigcode/commitpack
CommitPack is is a 4TB dataset of commits scraped from GitHub repositories that are permissively licensed.
7915k
1---2license: mit3pretty_name: CommitPack4language:5- code6---7 89 10# Dataset Card for CommitPack11 12## Table of Contents13- [Table of Contents](#table-of-contents)14- [Dataset Description](#dataset-description)15 - [Dataset Summary](#dataset-summary)16 - [Languages](#languages)17- [Dataset Structure](#dataset-structure)18 - [Data Instances](#data-instances)19 - [Data Fields](#data-fields)20 - [Data Splits](#data-splits)21- [Dataset Creation](#dataset-creation)22 - [Curation Rationale](#curation-rationale)23 - [Source Data](#source-data)24 - [Annotations](#annotations)25- [Additional Information](#additional-information)26 - [Licensing Information](#licensing-information)27 - [Citation Information](#citation-information)28 - [Contributions](#contributions)29 30## Dataset Description31 32- **Repository:** https://github.com/bigcode-project/octopack33- **Paper:** [OctoPack: Instruction Tuning Code Large Language Models](https://arxiv.org/abs/2308.07124)34- **Point of Contact:** [Niklas Muennighoff](mailto:n.muennighoff@gmail.com)35 36### Dataset Summary37 38> CommitPack is is a 4TB dataset of commits scraped from GitHub repositories that are permissively licensed.39 40- **Creation:** The dataset can be recreated using instructions available [here](https://github.com/bigcode-project/octopack).41- **Languages:** 35042- **OctoPack🐙🎒:**43 44<table>45<tr>46<th>Data</t> 47<td><a href=https://huggingface.co/datasets/bigcode/commitpack>CommitPack</a></td>48<td>4TB of GitHub commits across 350 programming languages</td>49</tr>50<tr>51<th></t> 52<td><a href=https://huggingface.co/datasets/bigcode/commitpackft>CommitPackFT</a></td>53<td>Filtered version of CommitPack for high-quality commit messages that resemble instructions</td>54</tr>55<tr>56<th>Model</t> 57<td><a href=https://huggingface.co/bigcode/octocoder>OctoCoder</a></td>58<td>StarCoder (16B parameters) instruction tuned on CommitPackFT + OASST</td>59</tr>60<tr>61<th></t> 62<td><a href=https://huggingface.co/bigcode/octogeex>OctoGeeX</a></td>63<td>CodeGeeX2 (6B parameters) instruction tuned on CommitPackFT + OASST</td>64</tr>65<tr>66<th>Evaluation</t> 67<td><a href=https://huggingface.co/datasets/bigcode/humanevalpack>HumanEvalPack</a></td>68<td>Extension of OpenAI's HumanEval to cover 3 scenarios across 6 languages</td>69</tr>70</table>71 72## Dataset Structure73 74 75### Data Instances76 77An example looks as follows:78 79```json80{81 'commit': '0c17311f7fd511f5dae8f8e4acc2dce1a2de3cf5',82 'old_file': 'main.py',83 'new_file': 'main.py',84 'old_contents': "import numpy as np\nimport matplotlib.pyplot as plt\n\n# generate sample data\nx_data = np.linspace(-5, 5, 20)\ny_data = np.random.normal(0.0, 1.0, x_data.size)\n\nplt.plot(x_data, y_data, 'o')\nplt.show()\n",85 'new_contents': "import math\nimport numpy as np\nimport matplotlib.pyplot as plt\n\n# generate sample data\nx_data = np.linspace(-math.pi, math.pi, 30)\ny_data = np.sin(x_data) + np.random.normal(0.0, 0.1, x_data.size)\n\nplt.plot(x_data, y_data, 'o')\nplt.show()\n\n",86 'subject': 'Change to sin() function with noise',87 'message': 'Change to sin() function with noise\n',88 'lang': 'Python',89 'license': 'mit',90 'repos': 'MorganR/basic-gaussian-process',91 'returncode': 0,92 'stderr': ''93}94```95 96### Data Fields97 98The data fields are the same among all splits:99- `commit`: unique commit id100- `old_file`: name of the file before the commit101- `new_file`: name of the file after the commit102- `old_contents`: contents of the file before the commit103- `new_contents`: contents of the file after the commit104- `subject`: subject of the commit (this is used for all experiments in the paper)105- `message`: message of the commit (commonly the same as the subject)106- `lang`: programming language107- `license`: license of the repository the code stems from, one of `['mit', 'artistic-2.0', 'isc', 'cc0-1.0', 'epl-1.0', 'mpl-2.0', 'unlicense', 'unknown', 'apache-2.0', 'bsd-3-clause', 'agpl-3.0', 'lgpl-2.1', 'bsd-2-clause']`108- `repos`: name of the the repository the code stems from (if multiple, they are comma separated)109- `returncode`: if applicable errorcode during scraping (0 = no error)110- 'stderr': if applicable the error that occured during scraping (empty = no error)111 112### Data Splits113 114| Name | Megabytes | % of total | Samples | % of total |115| --- | --- | --- | --- | --- |116| total | 3709175.78 | 100.0% | 57700105 | 100.0% |117| json | 583293.816 | 15.7257% | 3495038 | 6.0572% |118| xml | 279208.676 | 7.5275% | 1923159 | 3.333% |119| text | 270662.596 | 7.2971% | 1389525 | 2.4082% |120| javascript | 262824.844 | 7.0858% | 5401937 | 9.3621% |121| objective-c++ | 239009.3 | 6.4437% | 32227 | 0.0559% |122| python | 234311.564 | 6.3171% | 6189601 | 10.7272% |123| c | 200876.804 | 5.4157% | 2779478 | 4.8171% |124| c++ | 186585.256 | 5.0304% | 2402294 | 4.1634% |125| markdown | 171849.952 | 4.6331% | 7645354 | 13.2502% |126| java | 127103.448 | 3.4267% | 3744377 | 6.4894% |127| html | 105305.284 | 2.839% | 2366841 | 4.102% |128| yaml | 100466.64 | 2.7086% | 2592787 | 4.4936% |129| go | 86444.624 | 2.3306% | 1183612 | 2.0513% |130| csv | 82946.192 | 2.2362% | 79268 | 0.1374% |131| php | 74961.64 | 2.021% | 2555419 | 4.4288% |132| jupyter-notebook | 66854.08 | 1.8024% | 94000 | 0.1629% |133| gettext-catalog | 62296.88 | 1.6795% | 168327 | 0.2917% |134| sql | 56802.764 | 1.5314% | 132772 | 0.2301% |135| unity3d-asset | 39535.008 | 1.0659% | 17867 | 0.031% |136| typescript | 39254.804 | 1.0583% | 572136 | 0.9916% |137| web-ontology-language | 36435.464 | 0.9823% | 7458 | 0.0129% |138| ruby | 35830.74 | 0.966% | 2928702 | 5.0757% |139| c# | 33669.652 | 0.9077% | 923157 | 1.5999% |140| nix | 33547.92 | 0.9045% | 221281 | 0.3835% |141| shell | 25109.952 | 0.677% | 1017977 | 1.7643% |142| perl | 21148.928 | 0.5702% | 374266 | 0.6486% |143| tex | 17471.108 | 0.471% | 89283 | 0.1547% |144| css | 16306.632 | 0.4396% | 548818 | 0.9512% |145| restructuredtext | 15613.888 | 0.421% | 494037 | 0.8562% |146| rust | 15011.296 | 0.4047% | 296214 | 0.5134% |147| groff | 12020.188 | 0.3241% | 32923 | 0.0571% |148| ini | 8375.164 | 0.2258% | 297100 | 0.5149% |149| scala | 8325.96 | 0.2245% | 316064 | 0.5478% |150| coffeescript | 6795.14 | 0.1832% | 292446 | 0.5068% |151| haskell | 6306.12 | 0.17% | 217325 | 0.3766% |152| swift | 5902.716 | 0.1591% | 319289 | 0.5534% |153| lua | 5763.12 | 0.1554% | 139091 | 0.2411% |154| svg | 5645.44 | 0.1522% | 27095 | 0.047% |155| gas | 5585.384 | 0.1506% | 15121 | 0.0262% |156| ocaml | 5355.4 | 0.1444% | 81360 | 0.141% |157| erlang | 5043.32 | 0.136% | 93685 | 0.1624% |158| makefile | 4238.512 | 0.1143% | 343379 | 0.5951% |159| asciidoc | 4138.588 | 0.1116% | 96671 | 0.1675% |160| emacs-lisp | 3988.652 | 0.1075% | 83228 | 0.1442% |161| scss | 3944.936 | 0.1064% | 288190 | 0.4995% |162| clojure | 3523.408 | 0.095% | 158674 | 0.275% |163| org | 3126.22 | 0.0843% | 30198 | 0.0523% |164| common-lisp | 2954.904 | 0.0797% | 74628 | 0.1293% |165| diff | 2586.048 | 0.0697% | 21021 | 0.0364% |166| groovy | 2569.14 | 0.0693% | 110057 | 0.1907% |167| html+erb | 2450.676 | 0.0661% | 225379 | 0.3906% |168| nesc | 2439.564 | 0.0658% | 473 | 0.0008% |169| dart | 2395.796 | 0.0646% | 56873 | 0.0986% |170| powershell | 2289.276 | 0.0617% | 55381 | 0.096% |171| f# | 2289.236 | 0.0617% | 66840 | 0.1158% |172| dm | 2223.144 | 0.0599% | 55584 | 0.0963% |173| kotlin | 2219.248 | 0.0598% | 124266 | 0.2154% |174| pascal | 2194.676 | 0.0592% | 42511 | 0.0737% |175| jsx | 2124.744 | 0.0573% | 139148 | 0.2412% |176| viml | 1948.208 | 0.0525% | 74062 | 0.1284% |177| actionscript | 1844.148 | 0.0497% | 28819 | 0.0499% |178| cython | 1736.588 | 0.0468% | 25927 | 0.0449% |179| turtle | 1698.948 | 0.0458% | 3882 | 0.0067% |180| less | 1616.564 | 0.0436% | 88634 | 0.1536% |181| mathematica | 1475.044 | 0.0398% | 925 | 0.0016% |182| xslt | 1441.456 | 0.0389% | 27956 | 0.0485% |183| scheme | 1249.244 | 0.0337% | 30546 | 0.0529% |184| perl6 | 1223.16 | 0.033% | 12167 | 0.0211% |185| edn | 1186.94 | 0.032% | 2289 | 0.004% |186| fortran | 1178.548 | 0.0318% | 13463 | 0.0233% |187| java-server-pages | 1173.072 | 0.0316% | 53574 | 0.0928% |188| standard-ml | 1133.476 | 0.0306% | 20097 | 0.0348% |189| cmake | 1132.068 | 0.0305% | 58446 | 0.1013% |190| json5 | 1108.2 | 0.0299% | 1827 | 0.0032% |191| vala | 1104.512 | 0.0298% | 14822 | 0.0257% |192| vue | 1093.8 | 0.0295% | 68967 | 0.1195% |193| freemarker | 1032.332 | 0.0278% | 36216 | 0.0628% |194| graphql | 1004.844 | 0.0271% | 2009 | 0.0035% |195| twig | 958.96 | 0.0259% | 39588 | 0.0686% |196| tcl | 869.832 | 0.0235% | 16407 | 0.0284% |197| pod | 859.016 | 0.0232% | 14922 | 0.0259% |198| dockerfile | 849.728 | 0.0229% | 259379 | 0.4495% |199| yacc | 845.704 | 0.0228% | 8230 | 0.0143% |200| postscript | 800.728 | 0.0216% | 903 | 0.0016% |201| racket | 796.64 | 0.0215% | 16615 | 0.0288% |202| eagle | 785.684 | 0.0212% | 2237 | 0.0039% |203| haxe | 772.896 | 0.0208% | 28447 | 0.0493% |204| julia | 752.068 | 0.0203% | 22695 | 0.0393% |205| handlebars | 740.816 | 0.02% | 49842 | 0.0864% |206| smarty | 720.944 | 0.0194% | 41065 | 0.0712% |207| visual-basic | 681.516 | 0.0184% | 10511 | 0.0182% |208| literate-haskell | 673.74 | 0.0182% | 10729 | 0.0186% |209| smalltalk | 665.892 | 0.018% | 11741 | 0.0203% |210| isabelle | 655.82 | 0.0177% | 8359 | 0.0145% |211| nimrod | 652.86 | 0.0176% | 12023 | 0.0208% |212| zig | 621.384 | 0.0168% | 4290 | 0.0074% |213| m4 | 603.584 | 0.0163% | 12465 | 0.0216% |214| max | 603.56 | 0.0163% | 2259 | 0.0039% |215| elixir | 558.116 | 0.015% | 35473 | 0.0615% |216| mako | 543.012 | 0.0146% | 8943 | 0.0155% |217| arduino | 534.176 | 0.0144% | 32350 | 0.0561% |218| jade | 531.4 | 0.0143% | 46993 | 0.0814% |219| haml | 502.012 | 0.0135% | 74792 | 0.1296% |220| elm | 481.968 | 0.013% | 18542 | 0.0321% |221| purebasic | 474.276 | 0.0128% | 36 | 0.0001% |222| coldfusion | 470.78 | 0.0127% | 9263 | 0.0161% |223| lean | 470.032 | 0.0127% | 7507 | 0.013% |224| r | 454.32 | 0.0122% | 12858 | 0.0223% |225| cuda | 437.668 | 0.0118% | 11450 | 0.0198% |226| textile | 425.116 | 0.0115% | 18491 | 0.032% |227| robotframework | 421.612 | 0.0114% | 9211 | 0.016% |228| abap | 409.62 | 0.011% | 1955 | 0.0034% |229| rdoc | 397.028 | 0.0107% | 38760 | 0.0672% |230| llvm | 382.2 | 0.0103% | 10727 | 0.0186% |231| ada | 380.7 | 0.0103% | 13258 | 0.023% |232| batchfile | 372.16 | 0.01% | 43674 | 0.0757% |233| qml | 361.452 | 0.0097% | 19360 | 0.0336% |234| jasmin | 359.82 | 0.0097% | 4782 | 0.0083% |235| assembly | 343.62 | 0.0093% | 8126 | 0.0141% |236| g-code | 334.964 | 0.009% | 3690 | 0.0064% |237| cucumber | 331.38 | 0.0089% | 26677 | 0.0462% |238| html+php | 323.348 | 0.0087% | 18381 | 0.0319% |239| kicad | 321.936 | 0.0087% | 759 | 0.0013% |240| api-blueprint | 317.852 | 0.0086% | 4765 | 0.0083% |241| eiffel | 311.48 | 0.0084% | 373 | 0.0006% |242| toml | 292.676 | 0.0079% | 63517 | 0.1101% |243| modelica | 284.616 | 0.0077% | 2611 | 0.0045% |244| bitbake | 277.576 | 0.0075% | 43239 | 0.0749% |245| lex | 275.96 | 0.0074% | 705 | 0.0012% |246| stylus | 273.056 | 0.0074% | 21967 | 0.0381% |247| protocol-buffer | 254.124 | 0.0069% | 9202 | 0.0159% |248| unknown | 252.228 | 0.0068% | 30570 | 0.053% |249| nit | 244.54 | 0.0066% | 4951 | 0.0086% |250| factor | 241.192 | 0.0065% | 15378 | 0.0267% |251| xs | 239.04 | 0.0064% | 3215 | 0.0056% |252| sass | 230.648 | 0.0062% | 23144 | 0.0401% |253| parrot-internal-representation | 230.196 | 0.0062% | 6231 | 0.0108% |254| html+django | 217.04 | 0.0059% | 10535 | 0.0183% |255| mediawiki | 214.324 | 0.0058% | 10188 | 0.0177% |256| logos | 212.296 | 0.0057% | 1733 | 0.003% |257| genshi | 209.3 | 0.0056% | 956 | 0.0017% |258| coldfusion-cfc | 208.164 | 0.0056% | 4410 | 0.0076% |259| xtend | 179.544 | 0.0048% | 7775 | 0.0135% |260| sqf | 168.656 | 0.0045% | 7778 | 0.0135% |261| vhdl | 155.948 | 0.0042% | 2185 | 0.0038% |262| antlr | 143.548 | 0.0039% | 3651 | 0.0063% |263| systemverilog | 140.192 | 0.0038% | 3944 | 0.0068% |264| hcl | 136.752 | 0.0037% | 13379 | 0.0232% |265| asp | 136.104 | 0.0037% | 4286 | 0.0074% |266| nsis | 129.124 | 0.0035% | 4048 | 0.007% |267| inform-7 | 120.188 | 0.0032% | 184 | 0.0003% |268| slim | 119.036 | 0.0032% | 18726 | 0.0325% |269| groovy-server-pages | 117.368 | 0.0032% | 6695 | 0.0116% |270| ceylon | 116.144 | 0.0031% | 7256 | 0.0126% |271| fish | 111.28 | 0.003% | 15351 | 0.0266% |272| processing | 108.58 | 0.0029% | 5912 | 0.0102% |273| component-pascal | 105.5 | 0.0028% | 43 | 0.0001% |274| lasso | 104.168 | 0.0028% | 67 | 0.0001% |275| glsl | 99.488 | 0.0027% | 9478 | 0.0164% |276| saltstack | 98.196 | 0.0026% | 12314 | 0.0213% |277| xbase | 94.424 | 0.0025% | 1670 | 0.0029% |278| autohotkey | 94.22 | 0.0025% | 1452 | 0.0025% |279| liquid | 93.792 | 0.0025% | 2651 | 0.0046% |280| purescript | 92.412 | 0.0025% | 5024 | 0.0087% |281| agda | 92.06 | 0.0025% | 4956 | 0.0086% |282| inno-setup | 91.36 | 0.0025% | 3014 | 0.0052% |283| oz | 90.476 | 0.0024% | 1551 | 0.0027% |284| chapel | 89.62 | 0.0024% | 26447 | 0.0458% |285| arc | 87.212 | 0.0024% | 758 | 0.0013% |286| opencl | 86.432 | 0.0023% | 2489 | 0.0043% |287| graphviz-dot | 85.804 | 0.0023% | 1525 | 0.0026% |288| pawn | 85.424 | 0.0023% | 580 | 0.001% |289| jsoniq | 75.152 | 0.002% | 1343 | 0.0023% |290| bluespec | 72.38 | 0.002% | 2500 | 0.0043% |291| smali | 71.38 | 0.0019% | 174 | 0.0003% |292| krl | 69.868 | 0.0019% | 1879 | 0.0033% |293| maple | 68.284 | 0.0018% | 1311 | 0.0023% |294| unrealscript | 67.668 | 0.0018% | 585 | 0.001% |295| ooc | 63.188 | 0.0017% | 3416 | 0.0059% |296| pure-data | 62.624 | 0.0017% | 603 | 0.001% |297| xquery | 61.956 | 0.0017% | 2237 | 0.0039% |298| digital-command-language | 59.644 | 0.0016% | 833 | 0.0014% |299| moonscript | 59.208 | 0.0016% | 1951 | 0.0034% |300| awk | 57.176 | 0.0015% | 2206 | 0.0038% |301| pike | 52.872 | 0.0014% | 1262 | 0.0022% |302| livescript | 51.228 | 0.0014% | 5194 | 0.009% |303| solidity | 50.856 | 0.0014% | 3689 | 0.0064% |304| monkey | 48.256 | 0.0013% | 1367 | 0.0024% |305| jsonld | 48.012 | 0.0013% | 462 | 0.0008% |306| zephir | 42.684 | 0.0012% | 1265 | 0.0022% |307| crystal | 41.924 | 0.0011% | 4217 | 0.0073% |308| rhtml | 41.02 | 0.0011% | 4551 | 0.0079% |309| stata | 40.684 | 0.0011% | 1344 | 0.0023% |310| idris | 39.896 | 0.0011% | 3025 | 0.0052% |311| raml | 39.388 | 0.0011% | 948 | 0.0016% |312| openscad | 37.732 | 0.001% | 2178 | 0.0038% |313| red | 35.26 | 0.001% | 1108 | 0.0019% |314| c2hs-haskell | 34.472 | 0.0009% | 1021 | 0.0018% |315| cycript | 33.96 | 0.0009% | 197 | 0.0003% |316| applescript | 33.512 | 0.0009% | 1304 | 0.0023% |317| mupad | 32.488 | 0.0009% | 178 | 0.0003% |318| literate-agda | 31.384 | 0.0008% | 567 | 0.001% |319| boo | 31.172 | 0.0008% | 26289 | 0.0456% |320| sourcepawn | 29.528 | 0.0008% | 717 | 0.0012% |321| qmake | 29.508 | 0.0008% | 3632 | 0.0063% |322| ragel-in-ruby-host | 28.296 | 0.0008% | 888 | 0.0015% |323| io | 27.952 | 0.0008% | 1247 | 0.0022% |324| desktop | 27.648 | 0.0007% | 5021 | 0.0087% |325| propeller-spin | 26.772 | 0.0007% | 625 | 0.0011% |326| thrift | 26.748 | 0.0007% | 1007 | 0.0017% |327| volt | 25.052 | 0.0007% | 1660 | 0.0029% |328| xproc | 24.212 | 0.0007% | 914 | 0.0016% |329| igor-pro | 23.748 | 0.0006% | 388 | 0.0007% |330| lolcode | 23.74 | 0.0006% | 24861 | 0.0431% |331| html+eex | 21.412 | 0.0006% | 2100 | 0.0036% |332| logtalk | 20.428 | 0.0006% | 1035 | 0.0018% |333| mirah | 20.104 | 0.0005% | 706 | 0.0012% |334| gnuplot | 19.676 | 0.0005% | 889 | 0.0015% |335| literate-coffeescript | 19.016 | 0.0005% | 1041 | 0.0018% |336| jflex | 18.608 | 0.0005% | 555 | 0.001% |337| emberscript | 18.392 | 0.0005% | 1024 | 0.0018% |338| cobol | 17.0 | 0.0005% | 24953 | 0.0432% |339| yang | 16.94 | 0.0005% | 597 | 0.001% |340| rebol | 16.468 | 0.0004% | 239 | 0.0004% |341| linker-script | 16.084 | 0.0004% | 1604 | 0.0028% |342| cartocss | 15.916 | 0.0004% | 555 | 0.001% |343| urweb | 13.068 | 0.0004% | 304 | 0.0005% |344| rmarkdown | 13.032 | 0.0004% | 750 | 0.0013% |345| darcs-patch | 13.008 | 0.0004% | 80 | 0.0001% |346| csound | 12.852 | 0.0003% | 229 | 0.0004% |347| squirrel | 12.844 | 0.0003% | 531 | 0.0009% |348| apl | 12.56 | 0.0003% | 586 | 0.001% |349| hlsl | 12.168 | 0.0003% | 1529 | 0.0026% |350| latte | 11.888 | 0.0003% | 1380 | 0.0024% |351| pony | 11.836 | 0.0003% | 624 | 0.0011% |352| ioke | 10.86 | 0.0003% | 373 | 0.0006% |353| hy | 10.512 | 0.0003% | 879 | 0.0015% |354| uno | 10.356 | 0.0003% | 628 | 0.0011% |355| pan | 10.336 | 0.0003% | 637 | 0.0011% |356| xojo | 10.308 | 0.0003% | 642 | 0.0011% |357| papyrus | 10.256 | 0.0003% | 130 | 0.0002% |358| stan | 10.252 | 0.0003% | 540 | 0.0009% |359| slash | 9.904 | 0.0003% | 640 | 0.0011% |360| supercollider | 9.796 | 0.0003% | 318 | 0.0006% |361| vcl | 9.456 | 0.0003% | 747 | 0.0013% |362| smt | 9.032 | 0.0002% | 117 | 0.0002% |363| glyph | 8.948 | 0.0002% | 7 | 0.0% |364| wisp | 8.736 | 0.0002% | 262 | 0.0005% |365| renpy | 8.3 | 0.0002% | 421 | 0.0007% |366| clips | 7.728 | 0.0002% | 450 | 0.0008% |367| dns-zone | 7.56 | 0.0002% | 54 | 0.0001% |368| sas | 7.536 | 0.0002% | 269 | 0.0005% |369| rouge | 7.196 | 0.0002% | 396 | 0.0007% |370| ec | 7.032 | 0.0002% | 94 | 0.0002% |371| dylan | 6.82 | 0.0002% | 280 | 0.0005% |372| tcsh | 6.524 | 0.0002% | 748 | 0.0013% |373| aspectj | 6.332 | 0.0002% | 451 | 0.0008% |374| netlogo | 6.304 | 0.0002% | 140 | 0.0002% |375| gap | 6.096 | 0.0002% | 46 | 0.0001% |376| fancy | 5.952 | 0.0002% | 675 | 0.0012% |377| coq | 5.744 | 0.0002% | 80 | 0.0001% |378| click | 5.74 | 0.0002% | 9 | 0.0% |379| capn-proto | 5.644 | 0.0002% | 330 | 0.0006% |380| flux | 5.572 | 0.0002% | 47 | 0.0001% |381| forth | 5.512 | 0.0001% | 265 | 0.0005% |382| ats | 5.424 | 0.0001% | 383 | 0.0007% |383| netlinx | 5.172 | 0.0001% | 144 | 0.0002% |384| clean | 5.068 | 0.0001% | 171 | 0.0003% |385| parrot-assembly | 4.664 | 0.0001% | 227 | 0.0004% |386| alloy | 4.644 | 0.0001% | 203 | 0.0004% |387| lfe | 4.576 | 0.0001% | 287 | 0.0005% |388| gdscript | 4.488 | 0.0001% | 460 | 0.0008% |389| augeas | 4.444 | 0.0001% | 395 | 0.0007% |390| sparql | 4.404 | 0.0001% | 1036 | 0.0018% |391| lilypond | 4.308 | 0.0001% | 265 | 0.0005% |392| scilab | 4.088 | 0.0001% | 375 | 0.0006% |393| autoit | 4.06 | 0.0001% | 279 | 0.0005% |394| myghty | 3.864 | 0.0001% | 105 | 0.0002% |395| blitzmax | 3.74 | 0.0001% | 220 | 0.0004% |396| creole | 3.416 | 0.0001% | 337 | 0.0006% |397| harbour | 3.336 | 0.0001% | 107 | 0.0002% |398| piglatin | 3.168 | 0.0001% | 513 | 0.0009% |399| opa | 3.164 | 0.0001% | 211 | 0.0004% |400| sage | 3.032 | 0.0001% | 414 | 0.0007% |401| ston | 2.848 | 0.0001% | 414 | 0.0007% |402| maxscript | 2.8 | 0.0001% | 47 | 0.0001% |403| lsl | 2.68 | 0.0001% | 74 | 0.0001% |404| gentoo-ebuild | 2.576 | 0.0001% | 601 | 0.001% |405| nu | 2.38 | 0.0001% | 170 | 0.0003% |406| bro | 2.34 | 0.0001% | 333 | 0.0006% |407| xc | 2.02 | 0.0001% | 88 | 0.0002% |408| j | 1.808 | 0.0% | 142 | 0.0002% |409| metal | 1.724 | 0.0% | 151 | 0.0003% |410| module-management-system | 1.544 | 0.0% | 91 | 0.0002% |411| webidl | 1.508 | 0.0% | 96 | 0.0002% |412| tea | 1.468 | 0.0% | 29 | 0.0001% |413| redcode | 1.272 | 0.0% | 149 | 0.0003% |414| shen | 1.2 | 0.0% | 71 | 0.0001% |415| pov-ray-sdl | 1.136 | 0.0% | 104 | 0.0002% |416| x10 | 1.008 | 0.0% | 33 | 0.0001% |417| brainfuck | 0.964 | 0.0% | 167 | 0.0003% |418| ninja | 0.952 | 0.0% | 187 | 0.0003% |419| golo | 0.896 | 0.0% | 115 | 0.0002% |420| webassembly | 0.86 | 0.0% | 83 | 0.0001% |421| self | 0.824 | 0.0% | 15 | 0.0% |422| labview | 0.808 | 0.0% | 61 | 0.0001% |423| octave | 0.804 | 0.0% | 12 | 0.0% |424| pogoscript | 0.804 | 0.0% | 74 | 0.0001% |425| d | 0.796 | 0.0% | 20 | 0.0% |426| http | 0.736 | 0.0% | 140 | 0.0002% |427| ecl | 0.664 | 0.0% | 48 | 0.0001% |428| chuck | 0.584 | 0.0% | 99 | 0.0002% |429| gosu | 0.524 | 0.0% | 60 | 0.0001% |430| parrot | 0.52 | 0.0% | 17 | 0.0% |431| opal | 0.472 | 0.0% | 69 | 0.0001% |432| objective-j | 0.456 | 0.0% | 37 | 0.0001% |433| kit | 0.412 | 0.0% | 48 | 0.0001% |434| gams | 0.376 | 0.0% | 18 | 0.0% |435| prolog | 0.276 | 0.0% | 35 | 0.0001% |436| clarion | 0.268 | 0.0% | 13 | 0.0% |437| mask | 0.252 | 0.0% | 37 | 0.0001% |438| brightscript | 0.244 | 0.0% | 28 | 0.0% |439| scaml | 0.184 | 0.0% | 31 | 0.0001% |440| matlab | 0.164 | 0.0% | 29 | 0.0001% |441| idl | 0.148 | 0.0% | 1 | 0.0% |442| ags-script | 0.124 | 0.0% | 31 | 0.0001% |443| lookml | 0.12 | 0.0% | 10 | 0.0% |444| apacheconf | 0.108 | 0.0% | 59 | 0.0001% |445| oxygene | 0.104 | 0.0% | 9 | 0.0% |446| txl | 0.096 | 0.0% | 3 | 0.0% |447| grammatical-framework | 0.088 | 0.0% | 39 | 0.0001% |448| renderscript | 0.064 | 0.0% | 54 | 0.0001% |449| mtml | 0.052 | 0.0% | 13 | 0.0% |450| unified-parallel-c | 0.052 | 0.0% | 6 | 0.0% |451| dogescript | 0.04 | 0.0% | 10 | 0.0% |452| gentoo-eclass | 0.04 | 0.0% | 6 | 0.0% |453| zimpl | 0.04 | 0.0% | 7 | 0.0% |454| irc-log | 0.036 | 0.0% | 9 | 0.0% |455| fantom | 0.028 | 0.0% | 11 | 0.0% |456| numpy | 0.028 | 0.0% | 1 | 0.0% |457| cirru | 0.024 | 0.0% | 4 | 0.0% |458| xpages | 0.024 | 0.0% | 7 | 0.0% |459| nginx | 0.02 | 0.0% | 6 | 0.0% |460| objdump | 0.02 | 0.0% | 1 | 0.0% |461| python-traceback | 0.02 | 0.0% | 10 | 0.0% |462| realbasic | 0.012 | 0.0% | 1 | 0.0% |463| befunge | 0.008 | 0.0% | 2 | 0.0% |464| bison | 0.008 | 0.0% | 1 | 0.0% |465| m | 0.008 | 0.0% | 1 | 0.0% |466| omgrofl | 0.008 | 0.0% | 1 | 0.0% |467 468## Additional Information469 470### Licensing Information471 472Each sample comes from a code repository with a permissive license. The license is provided by the `license` field for each sample.473 474### Citation Information475 476```bibtex477@article{muennighoff2023octopack,478 title={OctoPack: Instruction Tuning Code Large Language Models}, 479 author={Niklas Muennighoff and Qian Liu and Armel Zebaze and Qinkai Zheng and Binyuan Hui and Terry Yue Zhuo and Swayam Singh and Xiangru Tang and Leandro von Werra and Shayne Longpre},480 journal={arXiv preprint arXiv:2308.07124},481 year={2023}482}483```484