blastwind/deprecated-github-code-haskell-function

1---2dataset_info:3  features:4  - name: repo_name5    dtype: string6  - name: path7    dtype: string8  - name: license9    dtype: string10  - name: full_code11    dtype: string12  - name: full_size13    dtype: int6414  - name: uncommented_code15    dtype: string16  - name: uncommented_size17    dtype: int6418  - name: function_only_code19    dtype: string20  - name: function_only_size21    dtype: int6422  - name: is_commented23    dtype: bool24  - name: is_signatured25    dtype: bool26  - name: n_ast_errors27    dtype: int6428  - name: ast_max_depth29    dtype: int6430  - name: n_whitespaces31    dtype: int6432  - name: n_ast_nodes33    dtype: int6434  - name: n_ast_terminals35    dtype: int6436  - name: n_ast_nonterminals37    dtype: int6438  - name: loc39    dtype: int6440  - name: cycloplexity41    dtype: int6442  splits:43  - name: train44    num_bytes: 216615757945    num_examples: 228438546  - name: valid47    num_bytes: 30777827648    num_examples: 32634149  - name: test50    num_bytes: 62075634851    num_examples: 65268252  download_size: 159707090353  dataset_size: 309469220354task_categories:55- text-generation56tags:57- code58- haskell59size_categories:60- 1M<n<10M61---62# Dataset Card for "github-code-haskell-function"63 64Rows: 3.26M65Download Size: 1.17GB66 67This dataset is extracted from [github-code-haskell-file](https://huggingface.co/datasets/blastwind/github-code-haskell-file).68 69Each row has 3 flavors of the same function: 70`uncommented_code`: Includes the function and its closest signature. 71`function_only_code`: Includes the function only.72`full_code`: Includes the function and its closest [signature](https://wiki.haskell.org/Type_signature) and comment. 73The heuristic for finding the closest signature and comment follows: If the immediate previous neighbor of the function 74is neither a signature nor comment, `full_code` is just the function. If the previous neighbor is one though, include 75them appropriately, then search the previous neighbor for the other node with the same logic.76 77Further, each row also contains attribute values for my personal analysis project. The attributes are calculated from the code in column `uncommented_code`. 787% (225k) of the rows have cyclomatic complexity and LOC valued at `-1` because [`homplexity`](https://github.com/BlastWind/homplexity) failed in parsing the row's `uncommented_code`.79