Team Ai
Modelpublic

athirdpath/Hestia-20b

sourceHugging Facecc-by-nc-4.0updated 3y agoView on Hugging Face
4likes63downloads
Model Card

This is a task_arithmetic merge of Harmonia (my 20b faux base model) with Noromaid and my LORA-glued Nethena. Solidly outperforms Harmonia.

mergemethod: taskarithmetic

base_model: athirdpath/Harmonia-20b

models:

  • —model: athirdpath/Harmonia-20b
  • —model: NeverSleep/Noromaid-20b-v0.1.1
  • —parameters: weight: 0.25
  • —model: athirdpath/Nethena-20b-Glued
  • —parameters: weight: 0.2

dtype: float16

Thanks to Undi95 for pioneering the 20B recipe, and for most of the models involved.