Team Ai
Datasetpublic

Brunobkr/llama.cpp_AlgMor24_github

ΩFFFΣLLIa • llama.cpp • AlgMor24 ██████╗ ███████╗███████╗███████╗██╗ ██╗ ██╗ █████╗ ██╔═══██╗██╔════╝██╔════╝██╔════╝██║ ██║ ██║██╔══██╗ ██║ ██║█████╗ █████╗ █████╗ ██║ ██║ ██║███████║ ██║ ██║██╔══╝ ██╔══╝ ██╔══╝ ██║ ██║ ██║██╔══██║ ╚██████╔╝██║ ██║ ███████╗███████╗███████╗██║██║ ██║ ╚═════╝ ╚═╝ ╚═╝ ╚══════╝╚══════╝╚══════╝╚═╝╚═╝ ╚═╝ High-Performance LLM / VLM Inference & Autonomous Agentic Ecosystem… See the full description on the dataset page: https://huggingface.co/datasets/Brunobkr/llama.cpp_AlgMor24_github.

sourceHugging Faceupdated 2mo agoView on Hugging Face
0likes3.1kdownloads
muse_glimmer.cpython-313.pyc51 linesDownload Raw Back to __pycache__
1�

2�pzj���0�SSKJr SSKrSSKJrJrJr SSKr\(aSSKJr SSK	J3r4JrJrJ
r
 SSjr\R"S5"S	S5\55r\R"S5"SS\655r\R"S
5"SS
\55rg)�)�annotationsN)�Any�Iterable�
TYPE_CHECKING)�Tensor�)�MmprojModel�	ModelBase�	TextModel�gguf���URS:XaFURup#URUSX!-S-U5RSS5R	X#5$URS:XaEURunURUSX!-S-5RSS5R	U5$[S[
UR535e)ڀInvert transformers' `_permute_for_rope`: HF stores Q/K in rotate_half layout,7llama.cpp consumes the interleaved (NORM) layout.�r�&_unpermute_for_rope: unexpected shape )�ndim�shape�view�	transpose�reshape�8ValueError�tuple)�tensor�n_heads�dim1�dim2s    �>/home/userk21/llama.cpp_algmor24_v2/conversion/muse_glimmer.py�_unpermute_for_ropers����{�{�a���\�\�9���{�{�7�A�t��!�';�T�B�L�L�Q�PQ�R�Z�Z�[_�f�f�
�{�{�a���,�,����{�{�7�A�t��!�';�<�F�F�q�!�L�T�T�UY�Z�Z�10�=�e�F�L�L�>Q�=R�S�11T�T��#MuseGlimmerForConditionalGeneration��t^�\rSrSr\R12RrSSjrSr	U4Sjr13SU4SjjrSrU=r
$)	�MuseGlimmerModel���6�URS5(aS$S$)N�layernorm.weightg�?�)�endswith)�self�names  r�14norm_shift�MuseGlimmerModel.norm_shifts���m�m�$6�7�7�s�@�S�@r����UR5 SSKJn URUR5nURS5n[
U[5(a#US:�aURRU5 ggg)Nr)�
AutoTokenizer�<|eot|>)15�_set_vocab_gpt2�transformersr0�from_pretrained�	dir_model�convert_tokens_to_ids�16isinstance�int�gguf_writer�add_eot_token_id)r*r0�tok�eot_ids    r�	set_vocab�MuseGlimmerModel.set_vocab"sd������.��+�+�D�N�N�;���*�*�9�5���f�c�"�"�v��{����-�-�f�5�(3�"r��X>�[TU]5 URnURR	US5 URRUS5 URR
US5 URRUSVs/sHo"S:HPM	 sn5 gs snf)N�final_logit_softcapping�output_multiplier�sliding_window�layer_types�sliding_attention)�super�set_gguf_parameters�hparamsr9�add_final_logit_softcapping�add_logit_scale�add_sliding_window�add_sliding_window_pattern)r*rH�t�	__class__s   �rrG�$MuseGlimmerModel.set_gguf_parameters+s����
��#�%��,�,�����4�4�W�=V�5W�X����(�(��1D�)E�F����+�+�G�4D�,E�F����3�3�W^�_l�Wm�4n�Wm�RS�:M�5M�Wm�4n�o��4ns�
B'�#�># �URU5nUS:waX-nSU;a#[U[URS55nO(SU;a"[U[URS55nUb�UR	SUS35(a�URSn[URS	5nUR
SUS1735[R"U4U[RS94v� UR
SUS35[R"U4[RS94v� [TU]1XU5Shv�N gN7f)
Nr(�.self_attn.q_proj.�num_attention_heads�.self_attn.k_proj.�num_key_value_heads�
model.layers.�.self_attn.q_proj.weight�head_dim�qk_scale_factor�.self_attn.q_norm.weight)�dtype�.self_attn.k_norm.weight)
r,rr8rHr)�float�map_tensor_name�torch�full�float32�onesrF�modify_tensors)r*�18data_torchr+�bid�shiftrX�q_scalerNs       �rrc�MuseGlimmerModel.modify_tensors4s3��������%���C�<�#�+�J� �4�'�,�Z��T�\�\�J_�=`�9a�b�J�
!�T�
)�,�Z��T�\�\�J_�=`�9a�b�J��?�t�}�}�}�S�E�AY�-Z�[�[��|�|�J�/�H��D�L�L�):�;�<�G��$�$�}�S�E�9Q�%R�S��19�20�H�;��u�}�}�E��
�21�$�$�}�S�E�9Q�%R�S��22�23�H�;�e�m�m�<��
�24�7�)�*�C�@�@�@�s�D;E�>E�?E�)r+�str�returnr]�rdrr+rjre�25int | Nonerk�Iterable[tuple[str, Tensor]])�__name__�26__module__�__qualname__�__firstlineno__r�27MODEL_ARCH�MUSE_GLIMMER�28model_archr,r=rGrc�__static_attributes__�
__classcell__�rNs@rr#r#s/������-�-�J�A�6�p�A�Arr#���^�\rSrSrSSjrU4Sjr\U4Sj5r\RRS4\RRS4\RRS4S.rS	rS29r
U=r$)�MuseGlimmerVisionModel�P��z�URRS5nU(dgUSUS-US-n0UESU0E$)N�
vision_config�pos_emb_height�30patch_size�31merge_size�32image_size)�
global_config�get)r*�cr�s   r�get_vision_config�(MuseGlimmerVisionModel.get_vision_configRsM�����"�"�?�3�����'�(�1�\�?�:�Q�|�_�L�33�.�!�.�\�:�.�.r��Z>�[TU]5 URceURnURR	[34RR5 URR[US55 URR[US55 g)N�layer_norm_epsr�)rFrG�hparams_visionr9�add_clip_projector_typer�VisionProjectorTypert�"add_vision_attention_layernorm_epsr]�add_vision_spatial_merge_sizer8)r*r�rNs  �rrG�*MuseGlimmerVisionModel.set_gguf_parametersZs����
��#�%��"�"�.�.�.��������0�0��1I�1I�1V�1V�W����;�;�E�!�DT�BU�<V�W����6�6�s�1�\�?�7K�Lr��l>^�UumnSn[U4SjU55(dg[TU]	TU45$)N)�model.vision_tower.�model.vision_adapter.�model.vision_projection.�3�D># �UHnTRU5v� M g7f�N)�35startswith)�.0�kr+s  �r�	<genexpr>�8MuseGlimmerVisionModel.filter_tensors.<locals>.<genexpr>gs����4�t�!�4�?�?�1�%�%�t�s� )�anyrF�filter_tensors)�cls�item�gen�keepr+rNs    @�rr��%MuseGlimmerVisionModel.filter_tensorscs9����	��c�[���4�t�4�4�4���w�%�t�S�k�2�2rrrr)�model.vision_adapter.fc1�model.vision_adapter.fc2�model.vision_projection�#�4# �URceSU;dSU;a#[URS5n[X5nURS5(a_URSn[URS5n[URS5nURXVSXw5R
S	S369nURS5up�n37X�R;a)URUup�URX�SU38-S9U4v� gURU5U4v� g7f)
N�
.attn.q_proj.�
.attn.k_proj.rS�%patch_embedder.patch_embedding.weightr�patch_temporalr��r)�dim�.)re�suffix)r�r8rr)rr�sum�39rpartition�_MM_MLP_MAP�format_tensor_namer^)
r*rdr+rer�n_embd�pt�ps�stem�_r��40tensor_key�idxs
             rrc�%MuseGlimmerVisionModel.modify_tensorsrs����"�"�.�.�.��d�"�o��&=��$�-�-�.C�D�E�G�,�Z�A�J��=�=�@�A�A��%�%�a�(�F��T�(�(�)9�:�;�B��T�(�(��6�7�B�#����Q��?�C�C��C�J�J��/�/�#�.�����#�#�#�"�.�.�t�4�O�J��*�*�:�s�V�|�*�T�V`�a�a���#�#�D�)�:�6�6�s�DDri)rk�dict[str, Any] | None)rorprqrrr�rG�classmethodr�r�MODEL_TENSOR�V_MMPROJr�rcrvrwrxs@rr{r{Psq���/�M��3��3�&*�%6�%6�%?�%?��$C�%)�%6�%6�%?�%?��$C�%)�%6�%6�%?�%?��$C��K�7�7rr{�MuseGlimmerAssistantModel��j^�\rSrSr\R41RrU4SjrU4Sjr	SSjr42SrU=r$)r����>�URc[S5eURnURUlSSKJn [URS-SSS9n[R"U5SS	nSSS5 U"W5nU[U5LaURU5 O[TU]%5 XlURRS435nUb%URR[U55 gg!,(df   N�=f)N�qMuseGlimmerAssistant (DFlash drafter) requires --target-model-dir pointing to the target MuseGlimmer HF directoryr)�get_model_class�config.json�r�utf-8)�encoding�
architecturesr�
mask_token_id)�target_model_dirrr5�r��open�json�load�typer=rFrHr�r9�add_mask_token_idr8)r*�original_dirr��f�target_arch�44target_clsr�rNs       �rr=�#MuseGlimmerAssistantModel.set_vocab�s����� � �(��2��
�45�~�~���.�.���%�
�$�'�'�-�7��w�
O�ST��)�)�A�,��7��:�K�P�$�[�1�46��T�$�Z�'�� � ��&��G���%�����(�(��9�
��$����.�.�s�=�/A�B�%�P�
O�s�C:�:47D��>�[TU]5 URnURR	[US55 URR
USVs/sHn[U5S-PM sn5 URS5(aoURS5(aXURR[US55 URRUSVs/sHo3S:HPM	 sn5 gggs snfs snf)N�48block_size�target_layer_idsrrCrDrE)49rFrGrHr9�add_block_sizer8�add_target_layersr�rKrL)r*�h�xrMrNs    �rrG�-MuseGlimmerAssistantModel.set_gguf_parameters�s����
��#�%��L�L�����'�'��A�l�O�(<�=�	
���*�*��BT�@U�+V�@U�1�C��F�Q�J�@U�+V�W��5�5�!�"�"�q�u�u�]�';�';����/�/��A�6F�4G�0H�I����7�7�[\�]j�[k�8l�[k�VW�>Q�9Q�[k�8l�m�(<�"��,W��9ms�D�,
D�#�6# �URU5U4v� g7fr�)r^)r*rdr+res    rrc�(MuseGlimmerAssistantModel.modify_tensors�s����#�#�D�)�:�6�6�s�)r5rl)
rorprqrrrrs�DFLASHrur=rGrcrvrwrxs@rr�r��s(������'�'�J�C�2n�7�7r)r�'Tensor'rr8rkr�)�50__future__rr��typingrrrr_r�baser	r51rrr�registerr#r{r�rirr�<module>r�s���"��/�/����9�9�	U����9�:�2A�y�2A�;�2A�j���9�:�17�[�17�;�17�h���/�0�-7�	�-7�1�-7r
Brunobkr/llama.cpp_AlgMor24_github · Team Ai