Team Ai
Modelpublic

tareq052/soccer-bert

sourceHugging Facemitupdated 2mo agoView on Hugging Face
1likes53downloads
Model Card

⚽ SOCCER BERT

A multilingual football-specific BERT model trained from scratch.

Model Details

PropertyValue
Parameters159M
ArchitectureDecoder-only Transformer
Layers10
Attention Heads8
Embedding Dim512
Context Length512 tokens
Vocab Size250,002 (XLM-RoBERTa)
Training Phase2 of 3
Dataset3.72 GB football + wikipedia
FormatSafetensors
StatusPrivate (Phase 3 SFT pending)

Languages

English, Spanish, Portuguese, Arabic, Bengali, Hindi

Citation

bibtex
@misc{Soccer-BERT-2026,
  author = {Tareq},
  title  = {Soccer BERT},
  year   = {2025},
  url    = {https://huggingface.co/tareq052/soccer-bert}
}