models
Open weights, fine-tunes and adapters. Every listing here comes live from the Hugging Face Hub, attributed to it, and links back to the source.
tiny-llama-fast-tokenizergemma-tokenizertinycomma-1.8b-llama3-tokenizerLlama3.2-3B-IT-with-Qwen2-TokenizerNousResearch-Meta-Llama-3-8B-Alternate-Tokenizer-GGUFLlama-3.2-1B-Instruct-tokenizerSanskrit-English-qwen2-tokenizerBabyLM-130M-ilm_it-ilm_pl-tokenizer_ilm_bilingual_it_pl_bpe_trailing_ws_32000Meta-Llama-3-8B-Alternate-TokenizerTokenizerTest-32m-BTokenizerTest-32m-ABabyLM-130M-ilm_it-ilm_pl-tokenizer_ilm_bilingual_it_pl_unigram_32000gemma2-tokenizerBabyLM-130M-ilm_eu-tokenizer_ilm_mono_eu_bpe_32000BabyLM-130M-ilm_it-tokenizer_ilm_mono_it_bpe_32000BabyLM-130M-ilm_es-tokenizer_ilm_mono_es_bpe_32000gemma3-270m-tinystories-gpt2-tokenizerBabyLM-130M-ilm_sl-tokenizer_ilm_mono_sl_bpe_32000BabyLM-130M-ilm_pl-tokenizer_ilm_mono_pl_bpe_32000Gemma2-2B-IT-with-Qwen2-TokenizerBabyLM-130M-ilm_pl-ilm_sl-tokenizer_ilm_bilingual_pl_sl_unigram_32000BabyLM-130M-ilm_pl-ilm_sl-tokenizer_ilm_bilingual_pl_sl_bpe_32000BabyLM-130M-ilm_it-ilm_sl-tokenizer_ilm_bilingual_it_sl_unigram_32000BabyLM-130M-ilm_eu-ilm_pl-tokenizer_ilm_bilingual_eu_pl_bpe_trailing_ws_32000BabyLM-130M-ilm_eu-ilm_sl-tokenizer_ilm_bilingual_eu_sl_bpe_32000BabyLM-130M-ilm_eu-ilm_it-tokenizer_ilm_bilingual_eu_it_bpe_32000BabyLM-130M-ilm_es-ilm_sl-tokenizer_ilm_bilingual_es_sl_bpe_trailing_ws_32000BabyLM-130M-ilm_es-ilm_pl-tokenizer_ilm_bilingual_es_pl_bpe_trailing_ws_32000BabyLM-130M-ilm_eu-ilm_sl-tokenizer_ilm_bilingual_eu_sl_unigram_32000BabyLM-130M-ilm_eu-ilm_sl-tokenizer_ilm_bilingual_eu_sl_bpe_trailing_ws_32000