bigcode/commitpackft
CommitPackFT is is a 2GB filtered version of CommitPack to contain only high-quality commit messages that resemble natural language instructions.
11434k
1---2license: mit3pretty_name: CommitPackFT4language:5- code6---7 89 10# Dataset Card for CommitPackFT11 12## Table of Contents13- [Table of Contents](#table-of-contents)14- [Dataset Description](#dataset-description)15 - [Dataset Summary](#dataset-summary)16 - [Languages](#languages)17- [Dataset Structure](#dataset-structure)18 - [Data Instances](#data-instances)19 - [Data Fields](#data-fields)20 - [Data Splits](#data-splits)21- [Dataset Creation](#dataset-creation)22 - [Curation Rationale](#curation-rationale)23 - [Source Data](#source-data)24 - [Annotations](#annotations)25- [Additional Information](#additional-information)26 - [Licensing Information](#licensing-information)27 - [Citation Information](#citation-information)28 - [Contributions](#contributions)29 30## Dataset Description31 32- **Repository:** https://github.com/bigcode-project/octopack33- **Paper:** [OctoPack: Instruction Tuning Code Large Language Models](https://arxiv.org/abs/2308.07124)34- **Point of Contact:** [Niklas Muennighoff](mailto:n.muennighoff@gmail.com)35 36### Dataset Summary37 38> CommitPackFT is a 2GB filtered version of [CommitPack](https://huggingface.co/datasets/bigcode/commitpack) to contain only high-quality commit messages that resemble natural language instructions.39> 40- **Creation:** The dataset can be recreated using instructions available [here](https://github.com/bigcode-project/octopack).41- **Languages:** 27742- **OctoPack🐙🎒:**43 44<table>45<tr>46<th>Data</t> 47<td><a href=https://huggingface.co/datasets/bigcode/commitpack>CommitPack</a></td>48<td>4TB of GitHub commits across 350 programming languages</td>49</tr>50<tr>51<th></t> 52<td><a href=https://huggingface.co/datasets/bigcode/commitpackft>CommitPackFT</a></td>53<td>Filtered version of CommitPack for high-quality commit messages that resemble instructions</td>54</tr>55<tr>56<th>Model</t> 57<td><a href=https://huggingface.co/bigcode/octocoder>OctoCoder</a></td>58<td>StarCoder (16B parameters) instruction tuned on CommitPackFT + OASST</td>59</tr>60<tr>61<th></t> 62<td><a href=https://huggingface.co/bigcode/octogeex>OctoGeeX</a></td>63<td>CodeGeeX2 (6B parameters) instruction tuned on CommitPackFT + OASST</td>64</tr>65<tr>66<th>Evaluation </t> 67<td><a href=https://huggingface.co/datasets/bigcode/humanevalpack>HumanEvalPack</a></td>68<td>Extension of OpenAI's HumanEval to cover 3 scenarios across 6 languages</td>69</tr>70</table>71 72## Dataset Structure73 74 75### Data Instances76 77 78An example looks as follows:79 80```json81{82 'commit': '0c17311f7fd511f5dae8f8e4acc2dce1a2de3cf5',83 'old_file': 'main.py',84 'new_file': 'main.py',85 'old_contents': "import numpy as np\nimport matplotlib.pyplot as plt\n\n# generate sample data\nx_data = np.linspace(-5, 5, 20)\ny_data = np.random.normal(0.0, 1.0, x_data.size)\n\nplt.plot(x_data, y_data, 'o')\nplt.show()\n",86 'new_contents': "import math\nimport numpy as np\nimport matplotlib.pyplot as plt\n\n# generate sample data\nx_data = np.linspace(-math.pi, math.pi, 30)\ny_data = np.sin(x_data) + np.random.normal(0.0, 0.1, x_data.size)\n\nplt.plot(x_data, y_data, 'o')\nplt.show()\n\n",87 'subject': 'Change to sin() function with noise',88 'message': 'Change to sin() function with noise\n',89 'lang': 'Python',90 'license': 'mit',91 'repos': 'MorganR/basic-gaussian-process'92}93```94 95### Data Fields96 97The data fields are the same among all splits:98- `commit`: unique commit id99- `old_file`: name of the file before the commit100- `new_file`: name of the file after the commit101- `old_contents`: contents of the file before the commit102- `new_contents`: contents of the file after the commit103- `subject`: subject of the commit (this is used for all experiments in the paper)104- `message`: message of the commit (commonly the same as the subject)105- `lang`: programming language106- `license`: license of the repository the code stems from, one of `['mit', 'artistic-2.0', 'isc', 'cc0-1.0', 'epl-1.0', 'mpl-2.0', 'unlicense', 'unknown', 'apache-2.0', 'bsd-3-clause', 'agpl-3.0', 'lgpl-2.1', 'bsd-2-clause']`107- `repos`: name of the the repository the code stems from (if multiple, they are comma separated)108 109### Data Splits110 111 112| Name | Megabytes | % of total | Samples | % of total |113| --- | --- | --- | --- | --- |114| total | 1545.02 | 100.0% | 702062 | 100.0% |115| ruby | 195.292 | 12.6401% | 69413 | 9.887% |116| yaml | 190.876 | 12.3543% | 114320 | 16.2835% |117| python | 132.68 | 8.5876% | 56025 | 7.9801% |118| markdown | 131.152 | 8.4887% | 62518 | 8.9049% |119| javascript | 125.008 | 8.091% | 52989 | 7.5476% |120| json | 86.744 | 5.6144% | 39777 | 5.6657% |121| shell | 66.864 | 4.3277% | 31217 | 4.4465% |122| text | 66.664 | 4.3148% | 46588 | 6.6359% |123| php | 60.22 | 3.8977% | 24791 | 3.5312% |124| java | 56.284 | 3.6429% | 20635 | 2.9392% |125| html | 48.42 | 3.1339% | 20214 | 2.8792% |126| c# | 26.84 | 1.7372% | 9346 | 1.3312% |127| xml | 23.676 | 1.5324% | 9337 | 1.3299% |128| html+erb | 23.104 | 1.4954% | 10910 | 1.554% |129| c | 21.08 | 1.3644% | 8506 | 1.2116% |130| ini | 21.04 | 1.3618% | 11360 | 1.6181% |131| coffeescript | 16.96 | 1.0977% | 5513 | 0.7853% |132| swift | 16.272 | 1.0532% | 4849 | 0.6907% |133| restructuredtext | 15.728 | 1.018% | 6560 | 0.9344% |134| typescript | 14.284 | 0.9245% | 5868 | 0.8358% |135| c++ | 14.136 | 0.9149% | 4992 | 0.711% |136| scss | 13.208 | 0.8549% | 6829 | 0.9727% |137| go | 12.132 | 0.7852% | 5004 | 0.7128% |138| scala | 11.184 | 0.7239% | 5040 | 0.7179% |139| haml | 10.74 | 0.6951% | 4415 | 0.6289% |140| css | 9.364 | 0.6061% | 5049 | 0.7192% |141| rust | 7.244 | 0.4689% | 2996 | 0.4267% |142| toml | 5.584 | 0.3614% | 3424 | 0.4877% |143| jsx | 5.5 | 0.356% | 2199 | 0.3132% |144| kotlin | 5.368 | 0.3474% | 2214 | 0.3154% |145| clojure | 5.068 | 0.328% | 2403 | 0.3423% |146| perl | 4.988 | 0.3228% | 2288 | 0.3259% |147| bitbake | 4.464 | 0.2889% | 1308 | 0.1863% |148| groovy | 4.168 | 0.2698% | 1486 | 0.2117% |149| twig | 3.956 | 0.256% | 1610 | 0.2293% |150| nix | 3.84 | 0.2485% | 1593 | 0.2269% |151| sql | 3.74 | 0.2421% | 2069 | 0.2947% |152| less | 3.724 | 0.241% | 1360 | 0.1937% |153| haskell | 3.308 | 0.2141% | 1389 | 0.1978% |154| handlebars | 3.292 | 0.2131% | 1429 | 0.2035% |155| unknown | 3.048 | 0.1973% | 1597 | 0.2275% |156| batchfile | 2.984 | 0.1931% | 1466 | 0.2088% |157| cucumber | 2.588 | 0.1675% | 976 | 0.139% |158| makefile | 2.528 | 0.1636% | 960 | 0.1367% |159| elixir | 2.348 | 0.152% | 1150 | 0.1638% |160| jade | 2.348 | 0.152% | 1119 | 0.1594% |161| cmake | 2.268 | 0.1468% | 981 | 0.1397% |162| powershell | 2.064 | 0.1336% | 991 | 0.1412% |163| slim | 2.056 | 0.1331% | 1052 | 0.1498% |164| emacs-lisp | 1.972 | 0.1276% | 1015 | 0.1446% |165| dart | 1.96 | 0.1269% | 765 | 0.109% |166| viml | 1.956 | 0.1266% | 1063 | 0.1514% |167| asciidoc | 1.864 | 0.1206% | 523 | 0.0745% |168| lua | 1.852 | 0.1199% | 920 | 0.131% |169| llvm | 1.6 | 0.1036% | 780 | 0.1111% |170| smarty | 1.588 | 0.1028% | 737 | 0.105% |171| diff | 1.48 | 0.0958% | 680 | 0.0969% |172| common-lisp | 1.448 | 0.0937% | 778 | 0.1108% |173| saltstack | 1.412 | 0.0914% | 617 | 0.0879% |174| vue | 1.384 | 0.0896% | 587 | 0.0836% |175| sass | 1.364 | 0.0883% | 705 | 0.1004% |176| fish | 1.328 | 0.086% | 813 | 0.1158% |177| erlang | 1.192 | 0.0772% | 480 | 0.0684% |178| freemarker | 1.028 | 0.0665% | 510 | 0.0726% |179| stylus | 0.948 | 0.0614% | 480 | 0.0684% |180| qml | 0.936 | 0.0606% | 368 | 0.0524% |181| hcl | 0.912 | 0.059% | 421 | 0.06% |182| html+django | 0.848 | 0.0549% | 399 | 0.0568% |183| mako | 0.756 | 0.0489% | 170 | 0.0242% |184| ada | 0.728 | 0.0471% | 265 | 0.0377% |185| ocaml | 0.704 | 0.0456% | 333 | 0.0474% |186| f# | 0.656 | 0.0425% | 254 | 0.0362% |187| elm | 0.62 | 0.0401% | 265 | 0.0377% |188| tex | 0.564 | 0.0365% | 307 | 0.0437% |189| rdoc | 0.552 | 0.0357% | 270 | 0.0385% |190| csv | 0.532 | 0.0344% | 375 | 0.0534% |191| protocol-buffer | 0.524 | 0.0339% | 181 | 0.0258% |192| smalltalk | 0.46 | 0.0298% | 284 | 0.0405% |193| arduino | 0.456 | 0.0295% | 225 | 0.032% |194| java-server-pages | 0.452 | 0.0293% | 173 | 0.0246% |195| scheme | 0.42 | 0.0272% | 213 | 0.0303% |196| groff | 0.396 | 0.0256% | 192 | 0.0273% |197| objective-c++ | 0.376 | 0.0243% | 86 | 0.0122% |198| desktop | 0.364 | 0.0236% | 186 | 0.0265% |199| factor | 0.356 | 0.023% | 113 | 0.0161% |200| crystal | 0.348 | 0.0225% | 182 | 0.0259% |201| rhtml | 0.348 | 0.0225% | 135 | 0.0192% |202| haxe | 0.344 | 0.0223% | 174 | 0.0248% |203| glsl | 0.34 | 0.022% | 164 | 0.0234% |204| gas | 0.336 | 0.0217% | 193 | 0.0275% |205| html+php | 0.332 | 0.0215% | 150 | 0.0214% |206| qmake | 0.32 | 0.0207% | 140 | 0.0199% |207| julia | 0.312 | 0.0202% | 180 | 0.0256% |208| cython | 0.308 | 0.0199% | 123 | 0.0175% |209| html+eex | 0.292 | 0.0189% | 135 | 0.0192% |210| tcl | 0.292 | 0.0189% | 103 | 0.0147% |211| org | 0.272 | 0.0176% | 136 | 0.0194% |212| perl6 | 0.268 | 0.0173% | 122 | 0.0174% |213| m4 | 0.264 | 0.0171% | 101 | 0.0144% |214| xslt | 0.256 | 0.0166% | 99 | 0.0141% |215| svg | 0.252 | 0.0163% | 169 | 0.0241% |216| nimrod | 0.236 | 0.0153% | 67 | 0.0095% |217| r | 0.228 | 0.0148% | 121 | 0.0172% |218| robotframework | 0.212 | 0.0137% | 85 | 0.0121% |219| racket | 0.196 | 0.0127% | 117 | 0.0167% |220| textile | 0.184 | 0.0119% | 61 | 0.0087% |221| assembly | 0.172 | 0.0111% | 105 | 0.015% |222| purescript | 0.172 | 0.0111% | 80 | 0.0114% |223| unity3d-asset | 0.156 | 0.0101% | 101 | 0.0144% |224| visual-basic | 0.152 | 0.0098% | 48 | 0.0068% |225| dm | 0.148 | 0.0096% | 16 | 0.0023% |226| pod | 0.148 | 0.0096% | 54 | 0.0077% |227| standard-ml | 0.148 | 0.0096% | 72 | 0.0103% |228| fortran | 0.144 | 0.0093% | 70 | 0.01% |229| gettext-catalog | 0.132 | 0.0085% | 72 | 0.0103% |230| idris | 0.132 | 0.0085% | 38 | 0.0054% |231| livescript | 0.128 | 0.0083% | 63 | 0.009% |232| xtend | 0.128 | 0.0083% | 55 | 0.0078% |233| actionscript | 0.12 | 0.0078% | 49 | 0.007% |234| vala | 0.116 | 0.0075% | 50 | 0.0071% |235| awk | 0.104 | 0.0067% | 52 | 0.0074% |236| ceylon | 0.1 | 0.0065% | 49 | 0.007% |237| jupyter-notebook | 0.1 | 0.0065% | 48 | 0.0068% |238| dockerfile | 0.096 | 0.0062% | 39 | 0.0056% |239| rouge | 0.096 | 0.0062% | 41 | 0.0058% |240| asp | 0.092 | 0.006% | 22 | 0.0031% |241| sqf | 0.092 | 0.006% | 45 | 0.0064% |242| edn | 0.088 | 0.0057% | 48 | 0.0068% |243| liquid | 0.088 | 0.0057% | 30 | 0.0043% |244| xquery | 0.084 | 0.0054% | 39 | 0.0056% |245| linker-script | 0.08 | 0.0052% | 37 | 0.0053% |246| mediawiki | 0.08 | 0.0052% | 33 | 0.0047% |247| parrot-internal-representation | 0.08 | 0.0052% | 23 | 0.0033% |248| solidity | 0.08 | 0.0052% | 37 | 0.0053% |249| json5 | 0.076 | 0.0049% | 33 | 0.0047% |250| systemverilog | 0.076 | 0.0049% | 35 | 0.005% |251| thrift | 0.076 | 0.0049% | 28 | 0.004% |252| groovy-server-pages | 0.072 | 0.0047% | 25 | 0.0036% |253| processing | 0.072 | 0.0047% | 35 | 0.005% |254| cuda | 0.068 | 0.0044% | 25 | 0.0036% |255| graphviz-dot | 0.068 | 0.0044% | 35 | 0.005% |256| inno-setup | 0.064 | 0.0041% | 16 | 0.0023% |257| api-blueprint | 0.06 | 0.0039% | 23 | 0.0033% |258| nsis | 0.06 | 0.0039% | 15 | 0.0021% |259| gentoo-ebuild | 0.056 | 0.0036% | 16 | 0.0023% |260| logtalk | 0.056 | 0.0036% | 21 | 0.003% |261| jasmin | 0.052 | 0.0034% | 9 | 0.0013% |262| literate-coffeescript | 0.052 | 0.0034% | 19 | 0.0027% |263| webidl | 0.052 | 0.0034% | 6 | 0.0009% |264| coldfusion-cfc | 0.048 | 0.0031% | 20 | 0.0028% |265| opencl | 0.048 | 0.0031% | 23 | 0.0033% |266| openscad | 0.048 | 0.0031% | 21 | 0.003% |267| pan | 0.048 | 0.0031% | 23 | 0.0033% |268| pascal | 0.048 | 0.0031% | 25 | 0.0036% |269| pony | 0.048 | 0.0031% | 16 | 0.0023% |270| turtle | 0.048 | 0.0031% | 21 | 0.003% |271| chapel | 0.044 | 0.0028% | 20 | 0.0028% |272| ioke | 0.044 | 0.0028% | 25 | 0.0036% |273| ooc | 0.044 | 0.0028% | 15 | 0.0021% |274| sparql | 0.044 | 0.0028% | 23 | 0.0033% |275| applescript | 0.04 | 0.0026% | 19 | 0.0027% |276| augeas | 0.04 | 0.0026% | 13 | 0.0019% |277| g-code | 0.04 | 0.0026% | 7 | 0.001% |278| mirah | 0.04 | 0.0026% | 16 | 0.0023% |279| capn-proto | 0.036 | 0.0023% | 12 | 0.0017% |280| digital-command-language | 0.036 | 0.0023% | 19 | 0.0027% |281| hy | 0.036 | 0.0023% | 12 | 0.0017% |282| logos | 0.036 | 0.0023% | 19 | 0.0027% |283| modelica | 0.036 | 0.0023% | 15 | 0.0021% |284| vcl | 0.036 | 0.0023% | 18 | 0.0026% |285| antlr | 0.032 | 0.0021% | 15 | 0.0021% |286| gdscript | 0.032 | 0.0021% | 9 | 0.0013% |287| graphql | 0.032 | 0.0021% | 17 | 0.0024% |288| hlsl | 0.032 | 0.0021% | 11 | 0.0016% |289| gnuplot | 0.028 | 0.0018% | 17 | 0.0024% |290| http | 0.028 | 0.0018% | 19 | 0.0027% |291| ninja | 0.028 | 0.0018% | 14 | 0.002% |292| oz | 0.028 | 0.0018% | 8 | 0.0011% |293| raml | 0.028 | 0.0018% | 9 | 0.0013% |294| aspectj | 0.024 | 0.0016% | 8 | 0.0011% |295| autohotkey | 0.024 | 0.0016% | 15 | 0.0021% |296| fancy | 0.024 | 0.0016% | 8 | 0.0011% |297| moonscript | 0.024 | 0.0016% | 10 | 0.0014% |298| piglatin | 0.024 | 0.0016% | 11 | 0.0016% |299| stata | 0.024 | 0.0016% | 10 | 0.0014% |300| urweb | 0.024 | 0.0016% | 6 | 0.0009% |301| xs | 0.024 | 0.0016% | 7 | 0.001% |302| yang | 0.024 | 0.0016% | 6 | 0.0009% |303| agda | 0.02 | 0.0013% | 10 | 0.0014% |304| coldfusion | 0.02 | 0.0013% | 9 | 0.0013% |305| emberscript | 0.02 | 0.0013% | 7 | 0.001% |306| latte | 0.02 | 0.0013% | 7 | 0.001% |307| literate-haskell | 0.02 | 0.0013% | 7 | 0.001% |308| postscript | 0.02 | 0.0013% | 9 | 0.0013% |309| scilab | 0.02 | 0.0013% | 10 | 0.0014% |310| tcsh | 0.02 | 0.0013% | 10 | 0.0014% |311| volt | 0.02 | 0.0013% | 9 | 0.0013% |312| apl | 0.016 | 0.001% | 7 | 0.001% |313| genshi | 0.016 | 0.001% | 3 | 0.0004% |314| jsonld | 0.016 | 0.001% | 6 | 0.0009% |315| krl | 0.016 | 0.001% | 4 | 0.0006% |316| lean | 0.016 | 0.001% | 3 | 0.0004% |317| lfe | 0.016 | 0.001% | 6 | 0.0009% |318| metal | 0.016 | 0.001% | 4 | 0.0006% |319| monkey | 0.016 | 0.001% | 4 | 0.0006% |320| mupad | 0.016 | 0.001% | 4 | 0.0006% |321| nesc | 0.016 | 0.001% | 7 | 0.001% |322| nit | 0.016 | 0.001% | 3 | 0.0004% |323| pike | 0.016 | 0.001% | 6 | 0.0009% |324| purebasic | 0.016 | 0.001% | 5 | 0.0007% |325| renpy | 0.016 | 0.001% | 3 | 0.0004% |326| vhdl | 0.016 | 0.001% | 5 | 0.0007% |327| xproc | 0.016 | 0.001% | 3 | 0.0004% |328| zephir | 0.016 | 0.001% | 4 | 0.0006% |329| apacheconf | 0.012 | 0.0008% | 2 | 0.0003% |330| boo | 0.012 | 0.0008% | 2 | 0.0003% |331| brainfuck | 0.012 | 0.0008% | 2 | 0.0003% |332| bro | 0.012 | 0.0008% | 3 | 0.0004% |333| cartocss | 0.012 | 0.0008% | 3 | 0.0004% |334| creole | 0.012 | 0.0008% | 2 | 0.0003% |335| csound | 0.012 | 0.0008% | 4 | 0.0006% |336| dylan | 0.012 | 0.0008% | 2 | 0.0003% |337| eagle | 0.012 | 0.0008% | 4 | 0.0006% |338| ecl | 0.012 | 0.0008% | 4 | 0.0006% |339| eiffel | 0.012 | 0.0008% | 2 | 0.0003% |340| flux | 0.012 | 0.0008% | 3 | 0.0004% |341| io | 0.012 | 0.0008% | 4 | 0.0006% |342| jsoniq | 0.012 | 0.0008% | 6 | 0.0009% |343| lilypond | 0.012 | 0.0008% | 6 | 0.0009% |344| lsl | 0.012 | 0.0008% | 3 | 0.0004% |345| mask | 0.012 | 0.0008% | 4 | 0.0006% |346| nginx | 0.012 | 0.0008% | 2 | 0.0003% |347| nu | 0.012 | 0.0008% | 2 | 0.0003% |348| pov-ray-sdl | 0.012 | 0.0008% | 5 | 0.0007% |349| ragel-in-ruby-host | 0.012 | 0.0008% | 4 | 0.0006% |350| slash | 0.012 | 0.0008% | 4 | 0.0006% |351| sourcepawn | 0.012 | 0.0008% | 3 | 0.0004% |352| squirrel | 0.012 | 0.0008% | 4 | 0.0006% |353| ston | 0.012 | 0.0008% | 6 | 0.0009% |354| uno | 0.012 | 0.0008% | 2 | 0.0003% |355| wisp | 0.012 | 0.0008% | 3 | 0.0004% |356| xbase | 0.012 | 0.0008% | 3 | 0.0004% |357| yacc | 0.012 | 0.0008% | 3 | 0.0004% |358| zig | 0.012 | 0.0008% | 4 | 0.0006% |359| abap | 0.008 | 0.0005% | 1 | 0.0001% |360| arc | 0.008 | 0.0005% | 2 | 0.0003% |361| ats | 0.008 | 0.0005% | 3 | 0.0004% |362| blitzmax | 0.008 | 0.0005% | 1 | 0.0001% |363| bluespec | 0.008 | 0.0005% | 2 | 0.0003% |364| c2hs-haskell | 0.008 | 0.0005% | 2 | 0.0003% |365| clean | 0.008 | 0.0005% | 1 | 0.0001% |366| dns-zone | 0.008 | 0.0005% | 2 | 0.0003% |367| forth | 0.008 | 0.0005% | 2 | 0.0003% |368| harbour | 0.008 | 0.0005% | 1 | 0.0001% |369| igor-pro | 0.008 | 0.0005% | 1 | 0.0001% |370| inform-7 | 0.008 | 0.0005% | 2 | 0.0003% |371| isabelle | 0.008 | 0.0005% | 2 | 0.0003% |372| jflex | 0.008 | 0.0005% | 1 | 0.0001% |373| literate-agda | 0.008 | 0.0005% | 1 | 0.0001% |374| maple | 0.008 | 0.0005% | 2 | 0.0003% |375| mathematica | 0.008 | 0.0005% | 1 | 0.0001% |376| module-management-system | 0.008 | 0.0005% | 1 | 0.0001% |377| mtml | 0.008 | 0.0005% | 2 | 0.0003% |378| netlinx | 0.008 | 0.0005% | 1 | 0.0001% |379| parrot-assembly | 0.008 | 0.0005% | 2 | 0.0003% |380| pawn | 0.008 | 0.0005% | 3 | 0.0004% |381| propeller-spin | 0.008 | 0.0005% | 1 | 0.0001% |382| pure-data | 0.008 | 0.0005% | 1 | 0.0001% |383| rebol | 0.008 | 0.0005% | 3 | 0.0004% |384| red | 0.008 | 0.0005% | 1 | 0.0001% |385| sage | 0.008 | 0.0005% | 1 | 0.0001% |386| sas | 0.008 | 0.0005% | 1 | 0.0001% |387| scaml | 0.008 | 0.0005% | 1 | 0.0001% |388| smt | 0.008 | 0.0005% | 3 | 0.0004% |389| supercollider | 0.008 | 0.0005% | 2 | 0.0003% |390| unrealscript | 0.008 | 0.0005% | 1 | 0.0001% |391| xpages | 0.008 | 0.0005% | 1 | 0.0001% |392 393## Additional Information394 395### Licensing Information396 397Each sample comes from a code repository with a permissive license. The license is provided by the `license` field for each sample.398 399### Citation Information400 401```bibtex402@article{muennighoff2023octopack,403 title={OctoPack: Instruction Tuning Code Large Language Models}, 404 author={Niklas Muennighoff and Qian Liu and Armel Zebaze and Qinkai Zheng and Binyuan Hui and Terry Yue Zhuo and Swayam Singh and Xiangru Tang and Leandro von Werra and Shayne Longpre},405 journal={arXiv preprint arXiv:2308.07124},406 year={2023}407}408```