Team Ai
Modelpublic

nilc-nlp/psst-model-8e-1s-difflib

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face
0likes5downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

psst-model-8e-1s-difflib

This model is a fine-tuned version of openai/whisper-large-v3 on an unknown dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.4445
  • —Wer: 0.1554
  • —Iu F1: 0.7255
  • —Iu Tp: 847
  • —Iu Fp: 490
  • —Iu Fn: 151

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 1e-05
  • —trainbatchsize: 4
  • —evalbatchsize: 8
  • —seed: 42
  • —gradientaccumulationsteps: 2
  • —totaltrainbatch_size: 8
  • —optimizer: Use adamwtorch with betas=(0.9,0.999) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
  • —lrschedulertype: linear
  • —lrschedulerwarmup_steps: 664
  • —training_steps: 9480

Training results

Training LossEpochStepValidation LossWerIu F1Iu TpIu FpIu Fn
0.96331.011850.49200.25780.5748461567115
0.63002.023700.47840.23900.7674442134134
0.34003.035550.49640.22160.7584449159127
0.15844.047400.55940.23210.7517451173125
0.05925.059250.60920.22690.7496455183121
0.02646.071100.69070.22020.7760452137124
0.01017.082950.73290.21960.7654429116147
0.00338.094800.77610.21490.7690446138130

Framework versions

  • —Transformers 5.6.2
  • —Pytorch 2.6.0+cu124
  • —Datasets 2.21.0
  • —Tokenizers 0.22.2