Team Ai
Modelpublic

HalogenFlo/microsoft-deberta-v3-base-emotion-recognition

sourceHugging Facemitupdated 5mo agoView on Hugging Face
1likes19downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

deberta-emotion-recognition

This model is a fine-tuned version of microsoft/deberta-v3-base on an unknown dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.5153
  • —Accuracy: 0.9325
  • —F1: 0.9075

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 2e-05
  • —trainbatchsize: 16
  • —evalbatchsize: 16
  • —seed: 42
  • —optimizer: Use OptimizerNames.ADAMWTORCHFUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
  • —lrschedulertype: linear
  • —lrschedulerwarmup_ratio: 0.1
  • —num_epochs: 20

Training results

Training LossEpochStepValidation LossAccuracyF1
0.47261.010000.43060.85850.8298
0.2372.020000.24730.9270.9025
0.22063.030000.16940.93650.9126
0.16544.040000.20240.9340.9134
0.11385.050000.24170.93250.9082
0.47686.060000.28550.93850.9169
0.01687.070000.41970.93850.9169
0.01218.080000.45210.9340.9119
0.19319.090000.52520.93350.9095
0.022110.0100000.50460.93950.9160
0.011211.0110000.51530.93250.9075

Framework versions

  • —Transformers 4.57.2
  • —Pytorch 2.11.0+cu128
  • —Datasets 4.8.5
  • —Tokenizers 0.22.2