Team Ai
Datasetpublic

Compactbot/slm-architecture-benchmark-specs

SLM Benchmark Protocol Specs A reference for the exact conventions to use when benchmarking very small language models (roughly 0.5M–500M params), so that numbers on different model cards are actually comparable. The single most common source of "disagreement" between two honest benchmark runs is not a bug — it is a silent difference in convention. This dataset pins those conventions down. Every convention here is either (a) something I verified end-to-end against a real… See the full description on the dataset page: https://huggingface.co/datasets/Compactbot/slm-architecture-benchmark-specs.

sourceHugging Faceapache-2.0updated 16d agoView on Hugging Face
0likes60downloads
settings

This repository belongs to Compactbot on Hugging Face.

Team Ai never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

nameslm-architecture-benchmark-specs
visibilitypublic
licenceapache-2.0
gatedno
ownerCompactbot
Account settings
Compactbot/slm-architecture-benchmark-specs · Team Ai