Modelpublic

SebastianBodza/DeepMagiCoder-6.7B-Magicoder-Base

sourceHugging Faceupdated 3y agoView on Hugging Face

0likes25downloads

mergekit_config.yml18 linesDownload Raw Back to root

1 2slices:3  - sources:4      - model: ise-uiuc/Magicoder-DS-6.7B5        layer_range: [0, 32]6      - model: deepseek-ai/deepseek-coder-6.7b-instruct7        layer_range: [0, 32]8merge_method: slerp9base_model: ise-uiuc/Magicoder-DS-6.7B10parameters:11  t:12    - filter: self_attn13      value: [0, 0.5, 0.3, 0.7, 1]14    - filter: mlp15      value: [1, 0.5, 0.7, 0.3, 0]16    - value: 0.517dtype: bfloat1618