datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
code_generation_liteLiveCodeBench is a temporaly updating benchmark for code generation. Please check the homepage: https://livecodebench.github.io/.loom-benchmark-livecodebenchcode_generation
LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
🏠 Home Page •
💻 GitHub Repository •
🏆 Leaderboard •
LiveCodeBench is a "live" updating benchmark for holistically evaluating code related capabilities of LLMs.
Particularly, it evaluates LLMs across a range of capabilties including code generation, self-repair, test output prediction, and code execution.
This is the code generation scenario of LiveCodeBench. It is also… See the full description on the dataset page: https://huggingface.co/datasets/livecodebench/code_generation.LiveCodeBench-Pro-Testcaselivecodebench-code_generation_liteimpossible_livecodebenchlivecodebench_code_generation_lite_parquet
LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
🏠 Home Page •
💻 GitHub Repository •
🏆 Leaderboard •
📄 Paper
Change Log
Since LiveCodeBench is a continuously updated benchmark, we provide different versions of the dataset. Particularly, we provide the following versions of the dataset:
release_v1: The initial release of the dataset with problems released between May 2023 and Mar 2024 containing 400… See the full description on the dataset page: https://huggingface.co/datasets/marianna13/livecodebench_code_generation_lite_parquet.LiveCodeBench-Proexecution-v2livecodebench-code_generation_litetest_generation
LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
🏠 Home Page •
💻 GitHub Repository •
🏆 Leaderboard •
LiveCodeBench is a "live" updating benchmark for holistically evaluating code related capabilities of LLMs.
Particularly, it evaluates LLMs across a range of capabilties including code generation, self-repair, test output prediction, and code execution.
This is the code generation scenario of LiveCodeBench. It is also… See the full description on the dataset page: https://huggingface.co/datasets/livecodebench/test_generation.livecodebench
LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
Note: This is a clone of livecodebench/code_generation_lite updated to work with recent versions of the datasets library. The original repository uses a Python loading script which is no longer supported. This version provides the same data using the standard JSONL format for compatibility.
Dataset Description
LiveCodeBench is a "live" updating benchmark for holistically… See the full description on the dataset page: https://huggingface.co/datasets/bzantium/livecodebench.LiveCodeBench-CPP
LiveCodeBench-CPP: An Extension of LiveCodeBench for Contamination Free Evaluation in C++
Overview
LiveCodeBench-CPP includes 454 problems from the release_v6 of LiveCodeBench, covering the period from October 2024 to May 2025. These problems are sourced from AtCoder (287 problems) and LeetCode (167 problems).
AtCoder Problems: These require generated solutions to read inputs from standard input (stdin) and write outputs to standard output (stdout). For unit testing, the… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/LiveCodeBench-CPP.execution
Dataset Card for "livecodebench-execute"
LiveCodeBench-v5livecodebench_code_generation_litelivecodebench-v6livecodebench-plus
LiveCodeBench-v6-Plus
A curated coding benchmark of 91 problems selected by hardness/discrimination
(lcb-v6-plus). It combines two sources, all in one clean schema:
64 evolved problems — mutated/evolved variants from LiveCodeBench-v6
(each carries its seed_problem).
27 original problems — un-evolved AtCoder problems taken directly from
livecodebench/code_generation_lite
release v6 (seed_problem is null).
About BenchEvolver
The evolved problems were produced by… See the full description on the dataset page: https://huggingface.co/datasets/BenchEvolver/livecodebench-plus.qwen3-8b-livecodebench-subset-v6-n128submissions
LiveCodeBench Submissions
To submit your models to LiveCodeBench, you can now use this huggingface repository to directly upload model generations. To submit the model generations, simply drag and drop your model generations folder here and create a pull request.
LiveCodeBench-SnapShot-0406
LiveCodeBench
Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"
🏠 Home Page •
💻 Data •
🏆 Leaderboard •
🔍 Explorer
Introduction
LiveCodeBench provides holistic and contamination-free evaluation of coding capabilities of LLMs. Particularly, LiveCodeBench continuously collects new problems over time from contests across three competition platforms -- LeetCode, AtCoder… See the full description on the dataset page: https://huggingface.co/datasets/tokenintelligence/LiveCodeBench-SnapShot-0406.livecodebench-code_generation_liteLiveCodeBenchqwen3-8b-livecodebench-v6-n128livecodebench-execute-v2ATX-Swift-Qwen3.8-27B-Uncensored-IQ4_XS-M-LiveCodeBench-v6
LiveCodeBench v6 — ATX Swift Qwen3.8-27B Uncensored IQ4_XS-M
Public reproducibility package for a four-seed direct code-generation evaluation of
jakeatx/ATX-Swift-Qwen3.8-27B-Uncensored-IQ4_XS-M-GGUF.
Result
357/400 = 89.25% pass@1 across four 100-task seeds. The arithmetic mean of the four seed rates is also 89.25%.
Qwen's published BF16 LiveCodeBench v6 figure is 90.3%; this run is 1.05 percentage points lower.
seed
passed
pass rate
0
90/100
90.00%… See the full description on the dataset page: https://huggingface.co/datasets/jakeatx/ATX-Swift-Qwen3.8-27B-Uncensored-IQ4_XS-M-LiveCodeBench-v6.ko-livecodebench
Ko-LiveCodeBench
This dataset is the livecodebench/code_generation_lite dataset with the question_content field translated to Korean.
Dataset Versions
The dataset provides multiple configurations (subsets) corresponding to different release versions:
release_v1: Problems released between May 2023 and Mar 2024 (400 problems)
release_v2: Problems released between May 2023 and May 2024 (511 problems)
release_v3: Problems released between May 2023 and Jul 2024 (612 problems)… See the full description on the dataset page: https://huggingface.co/datasets/bzantium/ko-livecodebench.routerarena-livecodebench-testsAg-LiveCodeBench-XThis repository contains the multi-PL variant of LiveCodeBench, prepared in the Agnostics project.
Find out more about the dataset and the related artifacts on the project website.
The easiest way to benchmark a model on this dataset is with our scripts.
LiveCodeBench-CodeGeneration