Team Ai
Datasetpublic

Yobitel/deepseek-ai-deepseek-coder-v2-lite-instruct__code-generation-mbpp-mini__019e3b6f7d82

deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct on code.generation.mbpp-mini (NVIDIA H100 80GB HBM3) Back to leaderboard Headline metrics Metric Value Unit N Samples 5 N Ok 5 Ok Rate 1 Pass At 1 1 Pass At 1 P05 1 Pass At 1 P50 1 Pass At 1 P95 1 Timeout Rate 0 TTFT P50 55.0369 ms Total P50 Ms 1212.8 Tokens Out Total 807 Run configuration Model: deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct @ unknown00 Engine:… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/deepseek-ai-deepseek-coder-v2-lite-instruct__code-generation-mbpp-mini__019e3b6f7d82.

sourceHugging Facecc-by-4.0updated 5mo agoView on Hugging Face
0likes40downloads
Dataset Card

deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct on code.generation.mbpp-mini (NVIDIA H100 80GB HBM3)

Back to leaderboard

Headline metrics

MetricValueUnit
N Samples5
N Ok5
Ok Rate1
Pass At 11
Pass At 1 P051
Pass At 1 P501
Pass At 1 P951
Timeout Rate0
TTFT P5055.0369ms
Total P50 Ms1212.8
Tokens Out Total807

Run configuration

  • —Model: deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct @ unknown00
  • —Engine: vllm vunknown
  • —Quantization: fp16
  • —Hardware: NVIDIA H100 80GB HBM3
  • —Driver: 580.126.09
  • —CUDA: 13.0
  • —Run date: 2026-05-18T14:13:42.914807+00:00
  • —Seed: 0

Verification

This result is Sigstore-signed and Rekor-logged. Verify:

bash
pip install inferencebench
bench verify hf://datasets/Yobitel/deepseek-ai-deepseek-coder-v2-lite-instruct__code-generation-mbpp-mini__019e3b6f7d82/envelope.json

Rekor entry: log index -1

Methodology

See the suite methodology page.

Citation

bibtex
@misc{inferencebench_019e3b6f7d82,
  title = { deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct on code.generation.mbpp-mini },
  author = { {InferenceBench community} },
  year = { 2026 },
  url = { https://huggingface.co/datasets/Yobitel/deepseek-ai-deepseek-coder-v2-lite-instruct__code-generation-mbpp-mini__019e3b6f7d82 },
}

Published via [InferenceBench](https://github.com/yobitelcomm/bench) — vendor-neutral AI benchmarks.