elinaparajuli/Codebert-Code-finetuned

1---2base_model: microsoft/codebert-base3tags:4- generated_from_trainer5model-index:6- name: Codebert-Code-finetuned7  results: []8---9 10<!-- This model card has been generated automatically according to the information the Trainer had access to. You11should probably proofread and complete it, then remove this comment. -->12 13# Codebert-Code-finetuned14 15This model is a fine-tuned version of [microsoft/codebert-base](https://huggingface.co/microsoft/codebert-base) on an unknown dataset.16It achieves the following results on the evaluation set:17- Loss: 0.000518 19## Model description20 21More information needed22 23## Intended uses & limitations24 25More information needed26 27## Training and evaluation data28 29More information needed30 31## Training procedure32 33### Training hyperparameters34 35The following hyperparameters were used during training:36- learning_rate: 2e-0537- train_batch_size: 838- eval_batch_size: 839- seed: 4240- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-0841- lr_scheduler_type: linear42- num_epochs: 3.043 44### Training results45 46| Training Loss | Epoch | Step | Validation Loss |47|:-------------:|:-----:|:----:|:---------------:|48| 0.0289        | 1.0   | 2567 | 0.0030          |49| 0.0036        | 2.0   | 5134 | 0.0008          |50| 0.0018        | 3.0   | 7701 | 0.0005          |51 52 53### Framework versions54 55- Transformers 4.40.056- Pytorch 2.2.1+cu12157- Datasets 2.19.058- Tokenizers 0.19.159