datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
LongBench-v2-for-llama.cppLongBench v2 converted for the llama.cpp perplexity multiple choice tool.
[!WARNING]
!! Currently does not work, will fix it in the near future. Probably.
LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitasks
🌐 Project Page: https://longbench2.github.io
💻 Github Repo: https://github.com/THUDM/LongBench
📚 Arxiv Paper: https://arxiv.org/abs/2412.15204
LongBench v2 is designed to assess the ability of LLMs to handle long-context problems… See the full description on the dataset page: https://huggingface.co/datasets/Green-Sky/LongBench-v2-for-llama.cpp.oa_cpp_annotate_gen
Dataset Description
This dataset, compiled by Brendan Dolan-Gavitt, contains ~100 thousand c++ functions and GPT-3.5 turbo-generated summaries of the code's purpose.
An example of Brendan's original prompt and GPT-3.5's summary may be found below.
int gg_set_focus_pos(gg_widget_t *widget, int x, int y) {
return 1;
}
Q. What language is the above code written in?
A. C/C++.
Q. What is the purpose of the above code?
A.
This code defines a function called `gg_set_focus_pos` that… See the full description on the dataset page: https://huggingface.co/datasets/casey-martin/oa_cpp_annotate_gen.CPP-Code-Solutions
C++ Code Solutions
Features
1000k of Python Code Solutions for Text Generation and Question Answering
C++ Coding Problems labelled by topic and difficulty
Recommendations
Train your Model on Logical Operations and Mathematical Problems Before Training it on this. This is optional for Fine Tuning 2B parameter + models.
Format the prompts in a orderly way when formatting data eg. {question} Solution: {solution} Topic: {topic}