sharoz/codegen-350M-mono-custom-functions-dataset-python

1---2license: bsd-3-clause3tags:4- generated_from_trainer5model-index:6- name: codegen-350M-mono-custom-functions-dataset-python7  results: []8---9 10<!-- This model card has been generated automatically according to the information the Trainer had access to. You11should probably proofread and complete it, then remove this comment. -->12 13# codegen-350M-mono-custom-functions-dataset-python14 15This model is a fine-tuned version of [Salesforce/codegen-350M-mono](https://huggingface.co/Salesforce/codegen-350M-mono) on the None dataset.16It achieves the following results on the evaluation set:17- Loss: 0.528918 19## Model description20 21More information needed22 23## Intended uses & limitations24 25More information needed26 27## Training and evaluation data28 29More information needed30 31## Training procedure32 33### Training hyperparameters34 35The following hyperparameters were used during training:36- learning_rate: 2e-0537- train_batch_size: 838- eval_batch_size: 839- seed: 4240- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-0841- lr_scheduler_type: linear42- num_epochs: 143 44### Training results45 46| Training Loss | Epoch | Step | Validation Loss |47|:-------------:|:-----:|:----:|:---------------:|48| No log        | 1.0   | 36   | 0.5289          |49 50 51### Framework versions52 53- Transformers 4.28.154- Pytorch 2.0.0+cu11855- Datasets 2.12.056- Tokenizers 0.13.357