Team Ai
Modelpublic

dougtrajano/toxic-comment-classification

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face
3likes119downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

dougtrajano/toxic-comment-classification

This model is a fine-tuned version of neuralmind/bert-large-portuguese-cased on the OLID-BR dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.4102
  • —Accuracy: 0.8547
  • —F1: 0.8549
  • —Precision: 0.8669
  • —Recall: 0.8547

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 3.255788747459486e-05
  • —trainbatchsize: 8
  • —evalbatchsize: 8
  • —seed: 1993
  • —optimizer: Adam with betas=(0.8445637934160373,0.8338816842140165) and epsilon=2.527092625455385e-08
  • —lrschedulertype: linear
  • —num_epochs: 30
  • —labelsmoothingfactor: 0.07158711257743958

Training results

Training LossEpochStepValidation LossAccuracyF1PrecisionRecall
0.44651.014080.41020.85470.85490.86690.8547
0.38392.028160.48140.85090.84970.85320.8509
0.39453.042240.63620.80020.79180.82580.8002
0.36434.056320.49610.82480.82110.83490.8248
0.33455.070400.52670.85280.85320.85700.8528
0.30536.084480.59020.80020.79110.82920.8002

Framework versions

  • —Transformers 4.26.1
  • —Pytorch 1.10.2+cu113
  • —Datasets 2.9.0
  • —Tokenizers 0.13.2