Team Ai
Modelpublic

deepdml/whisper-tiny-es-mix-norm

sourceHugging Faceapache-2.0updated 2mo agoView on Hugging Face
2likes51downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

Whisper Tiny es

This model is a fine-tuned version of openai/whisper-tiny on the following datasets:

  • —deepdml/commonvoice26_0
  • —disco-eth/WorldSpeech
  • —facebook/voxpopuli
  • —facebook/multilingual_librispeech
  • —deepdml/voxforge
  • —google/fleurs
  • —deepdml/basqueparliament1

It achieves the following results on the evaluation set:

  • —Best checkpoint: 44,000
  • —Loss: 0.2888
  • —Wer: 16.0693
  • —Cer: 6.0413

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 1e-05
  • —trainbatchsize: 128
  • —evalbatchsize: 128
  • —seed: 42
  • —optimizer: Use adamwtorch with betas=(0.9,0.999) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
  • —lrschedulertype: linear
  • —lrschedulerwarmup_steps: 0.04
  • —training_steps: 46000

Training results

Training LossEpochStepValidation LossWer RawCer RawWerCer
0.36630.021710000.597131.872212.147831.651012.1036
0.26250.043520000.514028.278910.556728.234510.5484
0.21830.065230000.476325.38939.274525.36839.2709
0.23200.087040000.443524.30339.007324.29449.0057
0.32900.108750000.436323.96739.111723.95909.1103
0.20300.130460000.411822.94288.574122.93908.5735
0.34560.152270000.413122.71908.658322.71398.6574
0.32840.173980000.399622.67528.456722.67278.4563
0.23360.195790000.369220.92367.928820.92237.9286
0.29500.2174100000.362221.14368.278821.14368.2788
0.38750.2391110000.357520.11977.546020.11977.5460
0.18841.0020120000.340619.39067.230819.39067.2308
0.13701.0237130000.337319.32157.362519.32157.3625
0.14261.0455140000.336419.12377.190319.12377.1903
0.16161.0672150000.332918.57856.959218.57856.9592
0.15601.0889160000.327819.09527.397719.09527.3977
0.15111.1107170000.330818.78777.280318.78777.2803
0.16421.1324180000.327618.35736.782318.35736.7823
0.24951.1542190000.330018.61087.057918.61087.0579
0.19031.1759200000.323218.45047.056118.45047.0561
0.19821.1976210000.316118.36367.071018.36367.0710
0.38911.2194220000.315418.52407.178718.52407.1787
0.27251.2411230000.315517.82606.692017.82606.6920
0.12712.0040240000.301617.15406.564617.15406.5646
0.11712.0257250000.309017.27006.555017.27006.5550
0.17382.0474260000.303717.37216.601517.37216.6015
0.15322.0692270000.306917.19776.433017.19776.4330
0.22202.0909280000.305617.41396.597917.41396.5979
0.15092.1127290000.301016.99236.529716.99236.5297
0.14842.1344300000.303316.78636.208416.78636.2084
0.15582.1561310000.302117.14076.501617.14076.5016
0.15632.1779320000.297916.66776.223616.66776.2236
0.28232.1996330000.300617.18506.491217.18506.4912
0.14632.2213340000.295516.60186.306816.60186.3068
0.12092.2431350000.291616.63736.395016.63736.3950
0.11453.0059360000.294116.88016.504816.88016.5048
0.15453.0277370000.292516.62086.409516.62086.4095
0.32113.0494380000.290516.63546.496616.63546.4966
0.19143.0712390000.292616.26456.148716.26456.1487
0.16723.0929400000.293616.55176.282816.55176.2828
0.12563.1146410000.291016.68616.522016.68616.5220
0.10233.1364420000.291816.41796.237616.41796.2376
0.15973.1581430000.291316.61516.425716.61516.4257
0.19123.1798440000.288816.06936.041316.06936.0413
0.14593.2016450000.289116.23796.110716.23796.1107
0.24853.2233460000.288916.34506.185216.34506.1852

Framework versions

  • —Transformers 5.14.1
  • —Pytorch 2.6.0+cu124
  • —Datasets 5.0.1
  • —Tokenizers 0.22.2

Citation

Please cite the model using the following BibTeX entry:

bibtex
@misc{deepdml/whisper-tiny-es-mix-norm,
      title={Fine-tuned Whisper tiny ASR model for speech recognition in Spanish},
      author={Jimenez, David},
      howpublished={\url{https://huggingface.co/deepdml/whisper-tiny-es-mix-norm}},
      year={2026}
    }