datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
python-fim
Python Stack | Fill-in-the-Middle
This is a conversion or adaptation of The Stack to a python FIM task. The example column is B64 encoded because people like to put special characters in their code that csv files dont like so I encoded the strings before saving them to disk.
Python-Code-Solutions
Python Code Solutions
Features
1000k of Python Code Solutions for Text Generation and Question Answering
Python Coding Problems labelled by topic and difficulty
Recommendations
Train your Model on Logical Operations and Mathematical Problems Before Training it on this. This is optional for Fine Tuning 2B parameter + models.
Format the prompts in a orderly way when formatting data eg. {question} Solution: {solution} Topic: {topic}
random-python-github-repositories
random-python-github-repositories
A collection of 1650 open-source Python GitHub repositories, packaged as zipped archives alongside a metadata CSV. Intended as a seed dataset for code retrieval, context engineering, and SWE-bench-style dataset construction tasks. All repos contain 250+ .py files.
Contents
repos_meta_data.csv — metadata for each repo (owner, repo_name, stars, license, py_file_count, alpha_hash)
repos-zipped/ — one .zip per repo, named… See the full description on the dataset page: https://huggingface.co/datasets/AmanPriyanshu/random-python-github-repositories.code_search_net_python_10000_examplespython_codes_sampleAlgorithm_and_Python_Source_CodeAlgorithm_and_Python_Source_Code
This dataset provides different algorithms and their corresponding source code in Python.
credits: Source codes given here are taken from "iamtarun/python_code_instructions_18k_alpaca" dataset in Hugging Face.
CodeSearchNet-Pythonmanim_pythonpython_datasetML-Python-Code-Smellspython-algorithm-sourcecode
Dataset Card for Dataset Name
This dataset card aims to be a base template for new datasets. It has been generated using this raw template.
Dataset Details
Dataset Description
This dataset provides algorithms and corresponding Python source code which can be leveraged for any type of code conversion applications.
Curated by: [More Information Needed]
Funded by [optional]: [More Information Needed]
Shared by [optional]: [More Information Needed]… See the full description on the dataset page: https://huggingface.co/datasets/annawleo/python-algorithm-sourcecode.45k_python_code_chinese_instruction
Dataset Card for Dataset Name
This dataset card aims to be a base template for new datasets. It has been generated using this raw template.
Dataset Details
中文提示的代码数据集
其中提示部分通过调用GPT-4.0-turbo API翻译成中文
Dataset Description
Curated by: [More Information Needed]
Funded by [optional]: [More Information Needed]
Shared by [optional]: [More Information Needed]
Language(s) (NLP): [More Information Needed]
License: [More Information Needed]
Dataset Sources… See the full description on the dataset page: https://huggingface.co/datasets/jean1/45k_python_code_chinese_instruction.CodeExercise-Python-27k-EVOLPubMedQAerrored_pythonThis is a subset of the python dataset provided but Ailurophile on Kaggle.
Important:Errors were introduced on purpose to try to test a sort of "specialized masking" in a realistic way.
Goal:The goal is to create a specialized agent, and add it to a chain with at least one other agent that generates code, and can hopefully "catch" any errors.
Inspiration:When working to generate datasets with other models, I found that even after multiple "passes" errors where still missed.
Out of curiosity… See the full description on the dataset page: https://huggingface.co/datasets/TacoPrime/errored_python.docs-python-v1
Dataset Card for Dataset Name
This dataset card aims to be a base template for creating python docs from methods. This is formatted from semeru/code-code-galeras-code-completion-from-docstring-3k-deduped
Dataset Description
Curated by: semeru/code-code-galeras-code-completion-from-docstring-3k-deduped
Language(s) (NLP): Python
License: [More Information Needed]
Dataset Sources [optional]
Repository:… See the full description on the dataset page: https://huggingface.co/datasets/ASHu2/docs-python-v1.PythonCombinedDataset is a combination of:
flytech/python-codes-25k,
Na0s/sft-ready-iamtarun-python-code-instructions-18k-alpaca,
mlabonne/Evol-Instruct-Python-26k,
iamtarun/python_code_instructions_18k_alpaca
This is a test for model building
packages_python_filtered
SWE-Next: Scalable Real-World Software Engineering Tasks for Agents
packages_python_filtered
This repository contains packages_python_filtered.csv, the seed repository list used by SWE-Next. The file contains 3,971 Python package / repository entries that serve as the starting point for large-scale repository mining and execution-grounded task synthesis.
Each row links a package-oriented seed entry to a GitHub repository and includes lightweight… See the full description on the dataset page: https://huggingface.co/datasets/TIGER-Lab/packages_python_filtered.python-raw-datasetawesome-python
www.awesomepython.org
Hand-picked awesome Python libraries, with an emphasis on data and machine learning 🐍
Dataset used by https://www.awesomepython.org/
license: mit
python_wiki_hallucination_graded
RAG + Instruction Following Results from Python Wikipedia benchmark
This dataset is an artifact from an experiment conducted by Arthur
Experiment
We wanted to compare how good LLMs are at answering questions using a context. Doing this task well involves an inverse skill: recognizing when the necessary information to answer a question is absent, and choosing instead to not answer. One name for this is “staying grounded” in the context that you provide in your prompt to… See the full description on the dataset page: https://huggingface.co/datasets/Arthur-AI/python_wiki_hallucination_graded.pythonMathSO-Python_QA-API_Usage-tanh_score
Stack Overflow Python Q&A Dataset
Description
Filtered Python Q&A with API_Usage subcategory without:
Images
Links
Blocks of code
Scores in Q1-Q3 scaled with MaxAbsScaler. Tanh function applyed to joint Scores.
simple_python_descriptionnepllmCodeNet_Python_118python-tf-ome-src-v4.1
Orthogonal Model of Emotions
Abbreviated: OME
Author
C.J. Pitchford
Creation Date
Originally created 2016, first version published September, 2017, at Medium.
Version
v4.1
Base Model
Latest model created using TensorFlow and Keras
finalized-ai-vs-human-python-10kecommerce-order-tracking-faqcode_search_net_python_10000_examples