Modelpublic

Delta-Vector/Pascal-Base-12B

sourceHugging Faceupdated 1y agoView on Hugging Face

1likes17downloads

README.md21 linesDownload Raw Back to root

1---2base_model:3- unsloth/gemma-3-12b-it4- NewEden/Gemma-LN-Lora5library_name: transformers6tags:7- mergekit8- merge9 10---11Hparams:12 13- LR: 1e-514- Weight Decay: 0.0215- grad-clip: 0.216- R64, A32, Rslora, 0.1 drop out, 16bit lora (qlora is cope.)17 18pretrained on a buncha LNs, books, etc.19Used for a base for Pascal.20 21