MSGEncrypted/repro-procedural-pretraining-warming-up-language-models-with-abstract-data

Reproduction: Procedural Pretraining: Warming Up Language Models with Abstract Data

An open experiment logbook, published with Trackio.