datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
rubygems-20241031rubygems-20230301cornstack-ruby-v1
CoRNStack Ruby Dataset
The CoRNStack Dataset, accepted to ICLR 2025, is a large-scale high quality training dataset specifically for code retrieval across multiple
programming languages. This dataset comprises of <query, positive, negative> triplets used to train nomic-embed-code,
CodeRankEmbed, and CodeRankLLM.
CoRNStack Dataset Curation
Starting with the deduplicated Stackv2, we create text-code pairs from function docstrings and respective code. We filtered out… See the full description on the dataset page: https://huggingface.co/datasets/nomic-ai/cornstack-ruby-v1.CodeSearchNet-ruby-qrelsEmploying the CoIR evaluation framework's dataset version, utilize the code below for assessment:
import coir
from coir.data_loader import get_tasks
from coir.evaluation import COIR
from coir.models import YourCustomDEModel
model_name = "intfloat/e5-base-v2"
# Load the model
model = YourCustomDEModel(model_name=model_name)
# Get tasks
#all task ["codetrans-dl","stackoverflow-qa","apps","codefeedback-mt","codefeedback-st","codetrans-contest","synthetic-
# text2sql","cosqa","codesearchnet"… See the full description on the dataset page: https://huggingface.co/datasets/CoIR-Retrieval/CodeSearchNet-ruby-qrels.CodeSearchNet-ruby-queries-corpus
Dataset Card for "CodeSearchNet-ruby-queries-corpus"
More Information needed
cornstack_ruby_ru_enThe CoRNStack Dataset translated into Russian. Translation was done with Qwen3-8B model.
RubyCraft-3.4-Instruct
RubyCraft-3.4-Instruct
RubyCraft-3.4-Instruct is a synthetically generated and rigorously filtered dataset designed to rapidly adapt Small Language Models (SLMs) to the latest programming language specifications, specifically Ruby 3.4.
This dataset demonstrates how high-performance code specialist models can be created at a negligible cost (approximately €4.20), effectively eliminating dependency on expensive, monolithic LLM APIs.
📊 Dataset Summary
The dataset is… See the full description on the dataset page: https://huggingface.co/datasets/mehmetdavut/RubyCraft-3.4-Instruct.codexglue_code2text_ruby
Dataset Card for "codexglue_code2text_ruby"
More Information needed
the-stack-ruby-clean
Dataset 1: TheStack - Ruby - Cleaned
Description: This dataset is drawn from TheStack Corpus, an open-source code dataset with over 3TB of GitHub data covering 48 programming languages. We selected a small portion of this dataset to optimize smaller language models for Ruby, a popular statically typed language.
Target Language: Ruby
Dataset Size:
Training: 900,000 files
Validation: 50,000 files
Test: 50,000 files
Preprocessing:
Selected Ruby as the target language due to its… See the full description on the dataset page: https://huggingface.co/datasets/ammarnasr/the-stack-ruby-clean.CodeSearchNet-ccr-ruby-queries-corpus
Dataset Card for "CodeSearchNet-ccr-ruby-queries-corpus"
More Information needed
CodeSearchNet-ccr-ruby-qrelsEmploying the CoIR evaluation framework's dataset version, utilize the code below for assessment:
import coir
from coir.data_loader import get_tasks
from coir.evaluation import COIR
from coir.models import YourCustomDEModel
model_name = "intfloat/e5-base-v2"
# Load the model
model = YourCustomDEModel(model_name=model_name)
# Get tasks
#all task ["codetrans-dl","stackoverflow-qa","apps","codefeedback-mt","codefeedback-st","codetrans-contest","synthetic-
# text2sql","cosqa","codesearchnet"… See the full description on the dataset page: https://huggingface.co/datasets/CoIR-Retrieval/CodeSearchNet-ccr-ruby-qrels.ruby-code-instructions-80k
Ruby Code Instructions - 80K
Instruction-tuning dataset of Ruby functions or methods paired with short natural-language instructions derived from repository docstrings or inline comments.
What changed in this release
This release keeps the original public rows and format, but makes the dataset easier to use responsibly:
exact duplicate rows were removed again using normalized instruction + output hashing
deterministic train, validation, and test splits were added
the… See the full description on the dataset page: https://huggingface.co/datasets/NickIBrody/ruby-code-instructions-80k.llm-redteam-corpus-taxonomy-core
LLM Red-Team Corpus + Taxonomy — Core
44,681 prompts for red-teaming and safety-testing LLMs. We collected them
from 9 public sources, checked every license, masked personal data, and saved
where each prompt came from. Load it in one line.
Use one clean dataset instead of downloading and fixing 9 red-team benchmarks by
hand. Every prompt keeps its source, license, and citation. The
core tier is safe to use in commercial products — every source is verified
MIT / Apache-2.0 /… See the full description on the dataset page: https://huggingface.co/datasets/RUBYGLASK/llm-redteam-corpus-taxonomy-core.code-text-ruby
Dataset is imported from CodeXGLUE and pre-processed using their script.
Where to find in Semeru:
The dataset can be found at /nfs/semeru/semeru_datasets/code_xglue/code-to-text/ruby in Semeru
CodeXGLUE -- Code-To-Text
Task Definition
The task is to generate natural language comments for a code, and evaluted by smoothed bleu-4 score.
Dataset
The dataset we use comes from CodeSearchNet and we filter the dataset as the following:
Remove… See the full description on the dataset page: https://huggingface.co/datasets/semeru/code-text-ruby.Ruby-Code-Large
Ruby-Code-Large
Ruby-Code-Large is a large-scale corpus of Ruby programming language source code comprising 331,743 code samples stored in .jsonl format. The dataset is designed to support research and development in large language model (LLM) pretraining, static analysis, web application development, and software engineering automation within the Ruby ecosystem.
By offering a substantial, language-focused dataset, Ruby-Code-Large enables targeted experimentation in dynamic… See the full description on the dataset page: https://huggingface.co/datasets/ajibawa-2023/Ruby-Code-Large.eval-fsr-a1-stack-ruby-swe-r469-rf0710-tracesinstructional_code-search-net-ruby
Dataset Card for "instructional_code-search-net-ruby"
Dataset Summary
This is an instructional dataset for Ruby.
The dataset contains two different kind of tasks:
Given a piece of code generate a description of what it does.
Given a description generate a piece of code that fulfils the description.
Languages
The dataset is in English.
Data Splits
There are no splits.
Dataset Creation
May of 2023
Curation Rationale
This dataset… See the full description on the dataset page: https://huggingface.co/datasets/Nan-Do/instructional_code-search-net-ruby.fda-warning-letter-escalation
FDA Warning Letter Escalation Dataset
Version: 1.0.0 | Records: 14,810 | Price: $2,000 | Source: FDA (public domain)
Dataset Summary
The dataset's core signal — whether an inspection escalated to a Warning Letter — is validated against FDA's own severity classifications: OAI inspections escalate at 64% versus 1.7% for NAI, a 39× relationship that confirms the data reflects real regulatory behavior.
The 14,810 inspections that escalated to enforcement — every… See the full description on the dataset page: https://huggingface.co/datasets/RubyIntelligence/fda-warning-letter-escalation.ruby-treesitter-filtered-datasetsV2
Ruby CodeSearch Dataset (Shuu12121/ruby-treesitter-filtered-datasetsV2)
Dataset Description
This dataset contains Ruby functions and methods paired with their documentation comments, extracted from open-source Ruby repositories on GitHub.
It is formatted similarly to the CodeSearchNet challenge dataset.
Each entry includes:
code: The source code of a ruby function or method.
docstring: The docstring or Javadoc associated with the function/method.
func_name: The name of… See the full description on the dataset page: https://huggingface.co/datasets/Shuu12121/ruby-treesitter-filtered-datasetsV2.ruby-treesitter-dedupe-filtered-datasetsV2
Ruby CodeSearch Dataset (Shuu12121/ruby-treesitter-dedupe-filtered-datasetsV2)
Dataset Description
This dataset contains Ruby functions and methods paired with their documentation comments, extracted from open-source Ruby repositories on GitHub.
It is formatted similarly to the CodeSearchNet challenge dataset.
Each entry includes:
code: The source code of a ruby function or method.
docstring: The docstring or Javadoc associated with the function/method.
func_name: The… See the full description on the dataset page: https://huggingface.co/datasets/Shuu12121/ruby-treesitter-dedupe-filtered-datasetsV2.rubygems-20230301ruby-rails-ja-en
Description
This is a WIP dataset!
This dataset contains Japanese and English sentences taken from Ruby and Ruby on Rails documentation websites. It also contains some synthetic data generated by Claude (TODO: label synthetic data vs. 'real' data).
Usage
Load dataset into your project
dataset = load_dataset("morinoko-inari/ruby-rails-ja-en", split="train")
Manually split into test and training sets
For example:
dataset =… See the full description on the dataset page: https://huggingface.co/datasets/morinoko-inari/ruby-rails-ja-en.code-search-net-ruby
Dataset Card for "code-search-net-ruby"
Dataset Summary
This dataset is the Ruby portion of the CodeSarchNet annotated with a summary column.The code-search-net dataset includes open source functions that include comments found at GitHub.The summary is a short description of what the function does.
Languages
The dataset's comments are in English and the functions are coded in Ruby
Data Splits
Train, test, validation labels are included in the… See the full description on the dataset page: https://huggingface.co/datasets/Nan-Do/code-search-net-ruby.exp_rpt_nemotron-ruby_10k_glm_4.7_traces_jupiterllm-redteam-corpus-taxonomy-extended
LLM Red-Team Corpus + Taxonomy — Extended (Non-Commercial)
⚠️ Non-commercial use only. For commercial use, see the sibling
rubyglask/llm-redteam-corpus-taxonomy-core
(CC-BY-4.0).
26,748 red-team / safety prompts from 3 non-commercial sources, in the same
schema as the core dataset. Kept separate so the core tier stays commercially
usable. PII (phone / address) is masked, same as core.
This is the non-commercial sources only. Want everything (all 12 sources,
64,458 rows)? →… See the full description on the dataset page: https://huggingface.co/datasets/RUBYGLASK/llm-redteam-corpus-taxonomy-extended.llm-redteam-corpus-taxonomy-full
LLM Red-Team Corpus + Taxonomy — Full (everything, non-commercial)
Every source in one download. We collected 12 public LLM red-team / safety
datasets, unified them into one schema, removed duplicates, masked personal
data, and kept where each prompt came from. 64,458 prompts. Load in one line.
This is the complete corpus — all 12 sources merged and de-duplicated across
tiers. Because it includes non-commercial sources (BeaverTails, ALERT,
ToxicChat) and ALERT is ShareAlike… See the full description on the dataset page: https://huggingface.co/datasets/RUBYGLASK/llm-redteam-corpus-taxonomy-full.RubyCraft-3.4-Eval-Logs
🚀 RubyCraft-3.4 Evaluation Logs
This dataset contains the comprehensive evaluation logs, including raw and processed outputs, for our research on the adaptation of Small Language Model (SLM) architectures to Ruby 3.4 syntax. It covers more than 26,000 evaluation rows generated across 96 LoRA configurations, 4 base models, and multiple teacher models.
⚡ Quick Performance Summary (The DSP Impact)
Our Diagnostic Sanitization Procedure (DSP) revealed massive hidden… See the full description on the dataset page: https://huggingface.co/datasets/mehmetdavut/RubyCraft-3.4-Eval-Logs.dataset_1github-file-programs-dataset-rubyterminal_bench_2_a1_stack_ruby_20260325_022705