Team Ai
Modelpublic

Djacon/rubert-tiny2-russian-emotion-detection

sourceHugging Facemitupdated 3y agoView on Hugging Face
9likes177downloads
Model Card

Short Description

The _rubert-tiny2-russian-emotion-detection is a fine-tuned [rubert-tiny2](https://huggingface.co/cointegrated/rubert-tiny2) model for multi-label emotion classification task, specifically on Russian texts. Trained on custom [ru-izard-emotions](https://huggingface.co/datasets/Djacon/ru-izard-emotions) dataset, so this model can recognize a spectrum of 9 emotions, including joy, sadness, anger, enthusiasm, surprise, disgust, fear, guilt, shame + neutral (no emotion). Project was inspired by the [Izard's model](https://en.wikipedia.org/wiki/DifferentialEmotions_Scale) of human emotions.

For more information about model, please check Github repository

Training Parameters:

yaml
Optimizer: AdamW
Schedule: LambdaLR
Learning Rate: 1e-4
Batch Size: 64
Number Of Epochs: 10

Emotion Categories:

js
0. Neutral (Нейтрально)
1. Joy (Радость)
2. Sadness (Грусть)
3. Anger (Гнев)
4. Enthusiasm (Интерес)
5. Surprise (Удивление)
6. Disgust (Отвращение)
7. Fear (Страх)
8. Guilt (Вина)
9. Shame (Стыд)

Test results:

NeutralJoySadnessAngerEnthusiasmSurpriseDisgustFearGuiltShameMean
AUC0.73190.82340.80690.78840.84930.80470.81470.90340.85280.71450.8090
F1 micro0.71920.79510.82040.76420.86300.90320.91560.94820.95260.96060.8642
F1 macro0.60210.72370.65480.62740.72910.57120.47800.81580.48790.49000.6180

Citations

@misc{Djacon,
  author={Djacon},
  year={2023},
  publisher={Hugging Face},
  journal={Hugging Face Hub},
}