minuva/MiniLMv2-goemotions-v2

Text Classification GoEmotions

This model is a fined-tuned version of MiniLMv2-L6-H384 on the on the go_emotions dataset. The quantized version in ONNX format can be found here

Load the Model

from transformers import pipeline

pipe = pipeline(model='minuva/MiniLMv2-goemotions-v2', task='text-classification')
pipe("I am angry")
# [{'label': 'anger', 'score': 0.9722517132759094}]

Training hyperparameters

The following hyperparameters were used during training:

• —learning_rate: 6e-05
• —trainbatchsize: 64
• —evalbatchsize: 64
• —seed: 42
• —optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• —lrschedulertype: linear

Metrics (comparison with teacher model)

Deployment

Check out our fast-nlp-text-emotion repository for a FastAPI based server to easily deploy this model on CPU devices.