robertp408/mms-1b-all-qxp

Finetuned facebook/mms-1b-all on 1502 Puno Quechua training audio samples from cmflnuzw781hfx067jwv4pt9x.

This model was created from the Mozilla.ai Blueprint: speech-to-text-finetune.

Evaluation results on 562 audio samples of Puno Quechua:

Baseline model (before finetuning) on Puno Quechua

• —Word Error Rate (Normalized): 146.227
• —Word Error Rate (Orthographic): 100.0
• —Character Error Rate (Normalized): 332.297
• —Character Error Rate (Orthographic): 344.813
• —Loss: 23.528

Finetuned model (after finetuning) on Puno Quechua

• —Word Error Rate (Normalized): 19.5
• —Word Error Rate (Orthographic): 32.432
• —Character Error Rate (Normalized): 2.718
• —Character Error Rate (Orthographic): 4.452
• —Loss: 0.163