unit-tests
Nutanix_-_CodeLlama-7b-Instruct-hf_cpp_unit_tests_full_finetuning_class_level-ggufMistral-7B-Instruct-v0.2_cpp_unit_tests_full_finetuning_class_levelNutanix_-_Mistral-7B-Instruct-v0.2_cpp_unit_tests_full_finetuning_class_level-8bitsCodeLlama-7b-Instruct-hf_cpp_unit_tests_full_finetuning_class_levelunit_test_save_modeltest_speech_unitMistral-7B-Instruct-v0.3_cpp_unit_tests_full_finetuning_class_levelNutanix_-_Mistral-7B-Instruct-v0.2_cpp_unit_tests_full_finetuning_class_level-4bits
UnitTests
UnitTests
Task description
Evaluation of unit-test generation for functions and methods in five programming languages (Java, Python, Go, JavaScript, and C#). Dataset contains 2500 tasks.
Evaluated skills: Instruction Following, Long Context Comprehension, Synthesis, Testing
Contributors: Alena Pestova, Valentin Malykh
Motivation
Unit testing is an important software development practice in which individual components of a software system are evaluated in… See the full description on the dataset page: https://huggingface.co/datasets/MERA-evaluation/UnitTests.cpp_unit_tests_benchmark_dataUnitTestsPublicseed_code_multiple_samples_scale_up_base_16K_unit_testscpp_unit_tests_benchmark_data_with_splitsLFQA_eval_dataset_unit_tests_contrastive