AlexBlin/software-engineering-model

1---2library_name: transformers3base_model: ai-forever/rugpt3small_based_on_gpt24tags:5- generated_from_trainer6model-index:7- name: software-engineering-model8  results: []9---10 11<!-- This model card has been generated automatically according to the information the Trainer had access to. You12should probably proofread and complete it, then remove this comment. -->13 14# software-engineering-model15 16This model is a fine-tuned version of [ai-forever/rugpt3small_based_on_gpt2](https://huggingface.co/ai-forever/rugpt3small_based_on_gpt2) on the None dataset.17 18## Model description19 20More information needed21 22## Intended uses & limitations23 24More information needed25 26## Training and evaluation data27 28More information needed29 30## Training procedure31 32### Training hyperparameters33 34The following hyperparameters were used during training:35- learning_rate: 5e-0536- train_batch_size: 137- eval_batch_size: 838- seed: 4239- optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments40- lr_scheduler_type: linear41- num_epochs: 542 43### Training results44 45 46 47### Framework versions48 49- Transformers 5.10.250- Pytorch 2.11.0+cu12851- Datasets 4.0.052- Tokenizers 0.22.253