Team Ai
Modelpublic

duraad/finetuning-b2b

sourceHugging Faceupdated 3y agoView on Hugging Face
0likes10downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

finetuning-b2b

This model is a fine-tuned version of dura-garage/nepberta2nepberta on an unknown dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.0000

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 5e-05
  • —trainbatchsize: 4
  • —evalbatchsize: 4
  • —seed: 42
  • —optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • —lrschedulertype: linear
  • —num_epochs: 10

Training results

Training LossEpochStepValidation Loss
0.00380.510000.0012
0.00091.020000.0007
0.00521.530000.0002
0.00692.040000.0002
0.00112.550000.0003
0.00453.060000.0007
0.00123.570000.0002
0.00284.080000.0001
0.00014.590000.0004
0.00015.0100000.0000
0.00925.5110000.0001
0.00066.0120000.0002
0.00036.5130000.0000
0.00577.0140000.0000
0.07.5150000.0000
0.00938.0160000.0000
0.038.5170000.0002
0.01449.0180000.0004
0.00189.5190000.0000
0.002410.0200000.0000

Framework versions

  • —Transformers 4.37.0
  • —Pytorch 2.1.2
  • —Datasets 2.17.0
  • —Tokenizers 0.15.1