Team Ai
Datasetpublic

Brunobkr/llama.cpp_AlgMor24_github

ΩFFFΣLLIa • llama.cpp • AlgMor24 ██████╗ ███████╗███████╗███████╗██╗ ██╗ ██╗ █████╗ ██╔═══██╗██╔════╝██╔════╝██╔════╝██║ ██║ ██║██╔══██╗ ██║ ██║█████╗ █████╗ █████╗ ██║ ██║ ██║███████║ ██║ ██║██╔══╝ ██╔══╝ ██╔══╝ ██║ ██║ ██║██╔══██║ ╚██████╔╝██║ ██║ ███████╗███████╗███████╗██║██║ ██║ ╚═════╝ ╚═╝ ╚═╝ ╚══════╝╚══════╝╚══════╝╚═╝╚═╝ ╚═╝ High-Performance LLM / VLM Inference & Autonomous Agentic Ecosystem… See the full description on the dataset page: https://huggingface.co/datasets/Brunobkr/llama.cpp_AlgMor24_github.

sourceHugging Faceupdated 2mo agoView on Hugging Face
0likes3.1kdownloads
nemotron.cpython-313.pyc97 linesDownload Raw Back to __pycache__
1�

2�pzjF[��4�SSKJr SSKJrJrJrJr SSKr\(aSSKJr SSK	J3r4JrJrJ
r
Jr SSKJr \R""SS	5"S5S\655r\R""S5"S
S\55r\R""S5"SS\55rg)�)�annotations)�Any�Callable�Iterable�
TYPE_CHECKINGN)�Tensor�)�MmprojModel�	ModelBase�	TextModel�gguf�logger)�GraniteHybridModel�NemotronH_Nano_VL_V2�7RADIOModel��^�\rSrSrSrSrSrSrS
SjrS
Sjr	U4Sjr8U4S	jr\SU4S9jj5r
SU4SjjrSrU=r$)�NemotronNanoV2VLModel�ii� ��	���URRS5nUcg0UEURURURUR10URRSS5S.EnU$)N�
vision_config�force_image_size�)�hidden_size�intermediate_size�num_hidden_layers�num_attention_heads�11image_size)�
global_config�get�_vit_hidden_size�_vit_intermediate_size�_vit_num_layers�_vit_num_heads)�selfrs  �:/home/userk21/llama.cpp_algmor24_v2/conversion/nemotron.py�get_vision_config�'NemotronNanoV2VLModel.get_vision_configsx���*�*�.�.��?�
�� ��12��13��0�0�!%�!<�!<�!%�!5�!5�#'�#6�#6��,�,�0�0�1C�S�I�
14�
�����8�URRS5$)N�sound_config)r"r#�r(s r)�get_audio_config�&NemotronNanoV2VLModel.get_audio_config*s���!�!�%�%�n�5�5r,��.>�SUR;a/SQURS'SUR;a/SQURS'URGbSUlSUlURRURS5 URR
S5 URRURS5 URRURS	5 URR[RR5 URR[RR5 O3URR[RR5 [ TU]E5 UR$nURR'S155 URR)S5 UR+SS5nURR-[/S
U-55 g)N�16image_mean)g17ףp=18�?g�v��/�?g�C�l���?�	image_std)gZd;�O�?gy�&1��?g�������?T�num_mel_binsg�h㈵��>�subsampling_factor�conv_kernel_sizeg�����ư>�downsample_ratio��?g�?)�preprocessor_config�
hparams_audio�has_vision_encoder�has_audio_encoder�gguf_writer�add_audio_num_mel_bins�!add_audio_attention_layernorm_eps�add_audio_subsampling_factor�add_audio_conv_kernel_size�add_clip_audio_projector_typer
�VisionProjectorType�PARAKEET�add_clip_vision_projector_type�NEMOTRON_V2_VL�add_clip_projector_type�super�set_gguf_parametersr"�"add_vision_attention_layernorm_eps�add_vision_use_gelur#�!add_vision_projector_scale_factor�int)r(�hparamsr:�	__class__s   �r)rL�)NemotronNanoV2VLModel.set_gguf_parameters-s�����t�7�7�7�5J�D�$�$�\�2��d�6�6�6�4I�D�$�$�[�1����)�&*�D�#�%)�D�"����3�3�D�4F�4F�~�4V�W����>�>�t�D����9�9�$�:L�:L�Ma�:b�c����7�7��8J�8J�K]�8^�_����:�:�4�;S�;S�;\�;\�]����;�;�D�<T�<T�<c�<c�d����4�4�T�5M�5M�5\�5\�]�
��#�%��$�$�����;�;�D�A����,�,�T�2�"�;�;�'9�3�?�����:�:�3�s�EU�?U�;V�Wr,���>�SU;dURS5(aLSU;dSU;a[RR$SU;a SU;a[RR$[TU]XX45$)N�
sound_encoder�mm.a.�bias�norm�conv�weight)�19startswithr
�GGMLQuantizationType�F32rK�tensor_force_quant)r(�name�new_name�bid�n_dimsrRs     �r)r_�(NemotronNanoV2VLModel.tensor_force_quantFso����d�"�h�&9�&9�'�&B�&B���!�V�x�%7��0�0�4�4�4���!�h�(�&:��0�0�4�4�4��w�)�$�#�F�Fr,���>�[TU]U5=ncgUup4SU;agSU;agURS5(dgSU;aURS5(dUS-
nSU;aSU;agX44$)N�input_conditioner�0radio_model.model.patch_generator.video_embedder)�vision_model.radio_model.model.�mlp1.�sound_encoder.�sound_projection.�patch_generator.pos_embed�.weight�	conv.norm�num_batches)rK�filter_tensorsr\�endswith)�cls�item�titemr`�genrRs     �r)rq�$NemotronNanoV2VLModel.filter_tensorsOs�����W�+�D�1�1�E�:���	���$�&��>��E�����r�s�s��&�$�.��=�=��+�+��	�!���$��=�D�#8���y�r,�#�n># �SU;a�SSKJs Jn URSnURRSS5nURSnXg-n[
URSS-5n	X�:waqURSX�U5nURSS	SS205R5nURXU4SSS
9nURSS21S	S5nURSX�-U5nSU;a1URSnURSnURUS	Xw5nSU;a3URS5nURS	SSS225R5nSU;anURS5(aX[UR5S	:Xa?URS23S:Xa,URURSURS5nSU;aCURS5(a-[UR5S:XaURSSSS5nSU;aCURS5(a-[UR5S:XaURSSSS5n[ TU]EXU5HHup�UR%S5(a(U24R%S5(aU25R'SS5n26X�4v� MJ g7f)Nrmrrrr�27patch_sizer	r;���bilinearT)�size�mode�
align_corners�patch_generator.embedder�depthwise_conv.weight������pointwise_convrn�subsampling.layers�.biasrl�
mm.model.mlp.�	mm.a.mlp.)�torch.nn.functional�nn�28functionalrQr"r#rP�shape�reshape�permute�float�interpolate�	unsqueeze�29contiguousrr�lenrK�modify_tensorsr\�replace)
r(�30data_torchr`rb�F�n_embdr!rz�target_patches_per_side�max_patches_per_side�mapped_name�tensorrRs
            �r)r��$NemotronNanoV2VLModel.modify_tensorsis�����&�$�.�+�+��\�\�-�0�F��+�+�/�/�0B�C�H�J����l�3�J�&0�&>�#�#&�31�(8�(8��(;��'C�#D� �&�>�'�/�/��3G�_e�f�32�'�/�/��1�a��;�A�A�C�33��]�]�:�Vm�<n�0:�$�+�P�34�'�/�/��1�a��;�35�'�/�/��3J�3d�fl�m�36�&��-����l�3�J��\�\�-�0�F�#�+�+�F�A�z�N�J�"�d�*�#�-�-�b�1�J�#�+�+�A�q�!�Q�7�B�B�D�J��t�#��
�
�i�(@�(@��:�#�#�$��)�j�.>�.>�q�.A�Q�.F�'�/�/�37�0@�0@��0C�Z�EU�EU�VW�EX�Y�38��4�'�D�M�M�'�,B�,B��:�#�#�$��)�'�/�/��2�q�!�<�39��t�#��
�
�g�(>�(>��:�#�#�$��)�'�/�/��2�q�!�<�40�#(�7�#9�*�C�#P��K����2�3�3��8N�8N��8_�8_�)�1�1�/�;�O���%�%�$Q�s�J2J5)r?r>)�return�dict[str, Any] | None�rt� tuple[str, Callable[[], Tensor]]r��'tuple[str, Callable[[], Tensor]] | None�r�rr`�strrb�41int | Noner��Iterable[tuple[str, Tensor]])�__name__�42__module__�__qualname__�__firstlineno__r$r%r&r'r*r1rLr_�classmethodrqr��__static_attributes__�
__classcell__�rRs@r)rrsO�����!���O��N�� 6�X�2G�����2-&�-&r,r�NemotronForCausalLM��j^�\rSrSr\R43RrSrU4Sjr	SU4Sjjr44SrU=r$)�
NemotronModel����UR5 URRS5 URRS5 g)Nrr	)�_set_vocab_sentencepiecer@�add_pad_token_id�add_unk_token_idr0s r)�	set_vocab�NemotronModel.set_vocab�s6���%�%�'����)�)�!�,����)�)�!�,r,��>�[TU]5 URnURR	US5 UR/SQ5nURR
U5 URSnURSS/5nURSS/5nURR[X4-5U-5 URRS5=(d URRS5nUc4URR[RR5 gURR[RR5 URR!U5 g)	N�45vocab_size)�layer_norm_eps�layer_norm_epsilon�norm_epsilon�norm_eps�partial_rotary_factorrr�r �n_head�factor)rKrLrQr@�add_vocab_size�find_hparam�add_layer_norm_eps�rope_parameters�add_rope_dimension_countrPr#�add_rope_scaling_typer
�RopeScalingType�NONE�LINEAR�add_rope_scaling_factor)r(rQ�46f_norm_eps�rot_pctr�r�r�rRs       �r)rL�!NemotronModel.set_gguf_parameters�s9���
��#�%��,�,�����'�'���(=�>��%�%�&j�k�47����+�+�J�7��&�&�'>�?���!�!�=�(�";�<���!�!�#8�(�"C�D�����1�1�#�g�6F�2G�6�2Q�R����!�!�(�+�Q�t�/C�/C�/G�/G��/Q���>����2�2�4�3G�3G�3L�3L�M����2�2�4�3G�3G�3N�3N�O����4�4�V�<r,�#�x># �URS5(aUS-n[TU]	XU5Shv�N gN7f)N�norm.weightr	)rrrKr�)r(r�r`rbrRs    �r)r��NemotronModel.modify_tensors�s5����48�=�=��'�'�#�a��J��7�)�*�C�@�@�@�s�/:�8�:�r�)
r�r�r�r�r
�49MODEL_ARCH�NEMOTRON�50model_archr�rLr�r�r�r�s@r)r�r��s(������)�)�J�-�51=�,A�Ar,r��NemotronHForCausalLM���^�\rSrSr%Sr\RRrSr	S\52S'SrU4SjrSr
\SU4S	jj5rSU4S53jjrU4SjrSrS
SSSSS.rSU4SjjrU4SjrSrU=r$)�NemotronHModel���)Hybrid mamba2/attention model from NVIDIAF�bool�is_moeT���>�[R"USUR5nSU;=(d. [UR	S5[545=(a SUS;nU(a&[RRUl	SUl55[T	U]0"U0UD6 URR	SURR	S55UlURcS5eURS/5UR -UlURR	S	5=(d URR	S565nUc/Ul/UlO�[U[(5(ak[+U5VVs/sHupgUS:XdM
UPM snnUl[+U5VVs/sH!upgXpR(aSOS
:XdMUPM# snnUlOX[+U5VVs/sHupgUS:XdM
UPM snnUl[+U5VVs/sHupgUS:XdM
UPM snnUlSUlUR(a�UR.(d�URR	SS5=(d SnUS:�a�US:XdS5eUR0UlU=R0S-
slUR2R5UR,5 UR&R5UR,5 [R6"URUR05UlUR:(aUR,c[=S5eggs snnfs snnfs snnfs snnf)Nr�num_experts_per_tok�57llm_configT�head_dim�attention_head_dim�/Could not find the attention head dim in config�	num_heads�hybrid_override_pattern�layers_block_type�M�E�-�mamba�moe�num_nextn_predict_layersr	�INemotronH MTP conversion currently supports num_nextn_predict_layers == 1�I--mtp was requested, but this model does not contain a supported MTP head)r�load_hparams�is_mistral_format�58isinstancer#�dictr
r��NEMOTRON_H_MOEr�r�rK�__init__rQr�r��d_model�d_inner�_ssm_layers�_mlp_layersr��	enumerate�_mtp_bid�no_mtp�block_count�_attn_layers�append�get_tensor_name_map�59tensor_map�mtp_only�60ValueError)61r(�args�kwargsrQ�has_moe_params�pattern�i�val�n_nextnrRs62         �r)r��NemotronHModel.__init__�s����63�(�(��a��$�2H�2H�I��!�W�,�
p��7�;�;�|�4�d�;�n�@U�Y`�am�Yn�@n�	��"�o�o�<�<�D�O��D�K�
���$�)�&�)����(�(��T�\�\�5E�5E�FZ�5[�\��
��}�}�(�[�*[�[�(��'�'��
�6����E����,�,�"�"�#<�=�f����AQ�AQ�Re�Af���?�!�D��!�D��
���
%�
%�09�'�0B�Q�0B�f�a�c�S�j��0B�Q�D��09�'�0B�k�0B�f�a�c�U`�U`�c�fi�Fj��0B�k�D��09�'�0B�U�0B�f�a�c�W�n��0B�U�D��09�'�0B�S�0B�f�a�c�U�l��0B�S�D��%)��
��;�;�t�{�{��l�l�&�&�'A�1�E�J��G���{��!�|��_��|�!%� 0� 0��
�� � �A�%� ��!�!�(�(����7�� � �'�'��
�
�6�"&�":�":�4�?�?�D�L\�L\�"]����=�=�T�]�]�2��h�i�i�3�=��- R��k��U��Ss0�M"�M"�-M(�M(�,M.�;M.�M4�'M4����URRS5=(d URRS5nUc/$[U5UR:Xd!S[U5SURS35e[	U[645(a'[
U5VVs/sHup#US:XdM
UPM snn$[
U5VVs/sHup#US:XdM
UPM snn$s snnfs snnf)Nr�r��Mismatch between pattern (�) and block_count (�)!�*�	attention)rQr#r�rr�r�r�)r(rrr
s    r)�get_attn_layers�NemotronHModel.get_attn_layerss����,�,�"�"�#<�=�f����AQ�AQ�Re�Af���?��I��7�|�t�/�/�/�	D�3M�c�RY�l�^�[n�os�o�o�oA�AC�2D�	D�/��g�s�#�#�$-�g�$6�E�$6�&�!�#��*�A�$6�E�E� )�'� 2�I� 2�f�a�c�[�6H�� 2�I�I��F��Is� C �/C �C&�C&��>�Uup#URS5(aUR(agOUR(a
US;nU(dg[TU]X#45$)N�mtp.)�backbone.embeddings.weight�backbone.norm_f.weight�lm_head.weight)r\rrrKrq)rsrtr`rv�keeprRs     �r)rq�NemotronHModel.filter_tensors
sX����	���?�?�6�"�"��z�z���
�\�\����D�65���w�%�t�k�2�2r,�66��>�URR5n[TU]
US9 UR(aU(dgUR67RRS5Sn[R"URRURRURRURRSUSS9nURRSUS3-Ulg)N)�68vocab_only�_r|)�69size_label�output_type�70model_type�mtp-�.gguf)�	fname_out�is_dirrK�prepare_metadatar�ftyper`�	partitionr
�naming_convention�metadata�basename�finetune�version�parent)r(r#�from_dirr&�
fname_defaultrRs     �r)r,�NemotronHModel.prepare_metadatas�����>�>�(�(�*��
�� �J� �7��}�}�H���:�:�?�?�4�4�S�9�!�<��!�3�3��M�M����
�
� 6� 6��
�
�8N�8N��M�M�!�!�d��X\�^�
����.�.�4�
��e�1L�L��r,��L>�[TU]5 URnUc[S5eURRU5 URR
U5 UR(ddUR/SQ5nURR[UR5Vs/sHo3UR;aUOSPM sn5 GOURSnURR[UR5Vs/sHo3UR;aUOSPM sn5 URRURS5 URRURS5 URR!URS5 URR#URS5 URR%URS5 URR'URS	5 URR)URS715 URR+URS5 URR-S5=nbURRU5 URR-S5=nbURR/U5 UR0b)URR3URS
5 ggs snfs snf)Nr�)r�n_inner�72hidden_dimr�moe_intermediate_sizer��#moe_shared_expert_intermediate_size�n_routed_experts�n_shared_experts�norm_topk_prob�routed_scaling_factor�n_group�moe_latent_sizer�)rKrLr�rr@�add_key_length�add_value_lengthr�r��add_feed_forward_length�rangerr�rQ�add_expert_used_count�add_expert_feed_forward_length�%add_expert_shared_feed_forward_length�add_expert_count�add_expert_shared_count�add_expert_weights_norm�add_expert_weights_scale�add_expert_group_countr#�add_moe_latent_sizer��add_nextn_predict_layers)r(r��n_ffrr<�n_experts_used�latent_sizerRs       �r)rL�"NemotronHModel.set_gguf_parameters+s����
��#�%��=�=�����N�O�O����'�'��1����)�)�(�3�73�{�{��#�#�$R�S�D����4�4�>C�D�DT�DT�>U�6�>U��T�-�-�-��1�4�>U�6�
�%)�L�L�1H�$I�!����4�4�OT�UY�Ue�Ue�Of�6�Of�!�d�.>�.>�)>�%�A�E�Of�6�
�
���2�2�4�<�<�@U�3V�W����;�;�D�L�L�I`�<a�b����B�B�4�<�<�Pu�Cv�w����-�-�d�l�l�;M�.N�O����4�4�T�\�\�BT�5U�V����4�4�T�\�\�BR�5S�T����5�5�d�l�l�CZ�6[�\����3�3�D�L�L��4K�L�#'�,�,�"2�"2�3H�"I�I��V�� � �6�6�~�F�#�|�|�/�/�0A�B�B��O�� � �4�4�[�A��=�=�$����5�5�d�l�l�C]�6^�_�%��36��746s�0L�L!����/n/nSSKJn URURSS9nSURS'URSnURRSS5nXV*-*U-nXPRS'[
URR55U:deURU5nURR5VV	s0sHup�X�_M	 n75nn	UR5nURn[U5GH�n
X�;a@URS	U
S7635 UR[R R"5 MIX�nX�;GaX�R$(dTUnUR'UR)USS95nX�:wa.[*R,"[/U5S
[/U5S35 X�R0(dUR3U5(a*UR[R R45 OtUR7SR'S5S5nUR[R R85 O)UR[R R:5 URU5 GM� UR<R?S5 UR<RAU5 UR<RCU5 UR<REU5 [RF"URSS9nURIUR<5 URJ(dUR<RMS5 ggs sn	nf)Nr)�
AutoTokenizerT)�trust_remote_code��pad_vocab_size_multipler�r�[PAD�]F)�add_special_tokens�  is encoded and decoded back to � using AutoTokenizers▁�utf-8� �gpt2)�load_merges)'�transformersrX�from_pretrained�	dir_modelrQr#�max�vocab�values�get_vocab_base_pre�items�get_added_vocab�added_tokens_decoderrGrr
�	TokenType�UNUSED�77normalized�decode�encoder�info�repr�special�does_token_look_special�CONTROLr��USER_DEFINED�NORMALr@�add_tokenizer_model�add_tokenizer_pre�add_token_list�add_token_types�SpecialVocab�add_to_ggufr��add_add_bos_token)r(�tokens�toktypesrX�	tokenizerr��	pad_vocab�tokpre�encoded_tok�id_�
reverse_vocab�added_vocabrnr�token�previous_token�
special_vocabs                 r)r��NemotronHModel.set_vocabUs���78�� ��.�!�1�1�$�.�.�TX�1�Y�	�34����.�/��\�\�,�/�79��L�L�$�$�%>��C�	�!�Z�/�0�9�<�80�%/���\�"��9�?�?�)�)�+�,�z�9�9�9��(�(��3��BK�/�/�BW�BW�BY�Z�BY�.>�k��)�BY�
�Z��/�/�1��(�=�=���z�"�A��%��
�
��Q�C�q�k�*������� 5� 5�6�*�-���'�/�2�=�=�).�� )� 0� 0��1A�1A�%�\a�1A�1b� c��)�2�"�K�K�4��+?�*@�@`�ae�fk�al�`m�nB�)C�D�+�.�6�6�$�:V�:V�W\�:]�:]� ������(>�(>�?� %�
�
�o�.D�.D�W�.M�s� S�� ������(C�(C�D��O�O�D�N�N�$9�$9�:��
�
�e�$�)#�.	
���,�,�V�4����*�*�6�2����'�'��/����(�(��2��)�)�$�.�.�d�K�
��!�!�$�"2�"2�3�81�{�{����.�.�t�4���O[s�

M/�model.layers.{bid}.enorm.weight�model.layers.{bid}.hnorm.weight�!model.layers.{bid}.eh_proj.weight�2model.layers.{bid}.post_attention_layernorm.weight�*model.layers.{bid}.shared_head.norm.weight)�mtp.layers.0.enorm.weight�mtp.layers.0.hnorm.weight�mtp.layers.0.eh_proj.weight�mtp.layers.1.norm.weight�#mtp.layers.1.final_layernorm.weight�	#�># �URbpURS5(aZURSS5SnURnURR	U5nU(aURUS9OSUSU3nUR(GaUGbURS5(a [R"XX#5Shv�N gURS5(a2URSS	5n[R"XXc5Shv�N gURS825(a0UR5n[R"XX#5Shv�N gURS5(aW[R"U5*nUR5RSS
5n	[R"X	X#5Shv�N gURS5(a@UR5RSS
5n	[R"X	X#5Shv�N gURS5(a<URURS5n	[R"X	X#5Shv�N gUR!S5S:wGaUR"Sn83UceUR$c*['UR(5Vs/sHn0PM snUlXR$UU'[+UR$U5U84S-:�a�SH�n/n
['U855H@nSUSUSUS3nU
R-UR$UU5 UR$UU	MB [R."U
SS9nSUSUS3n[R"XUU5Shv�N M� gg[0TU]%XU5Shv�N gGN�GN�GNeGN�GN�GNYs snfN:N7f)N)�
mtp.layers.0.�
mtp.layers.1.�.r{)rb�backbone.layers.�"mixer.gate.e_score_correction.bias�
mixer.dt_bias�dt_bias�dt.bias�mixer.conv1d.weight�mixer.A_logr�r	�mixer.D�mixer.norm.weight�
mixer.expertsr>r|)�	down_proj�up_proj�.mixer.experts.rnr)�dim�
model.layers.�
.mlp.experts.)r�r\�split�_MTP_SPECIAL_RENAMESr#�formatr�rrrr�r��squeeze�torch�expr�rB�findrQ�_expertsrGrr�r�stackrK)r(r�r`rb�suffix�renamedra�
squeezed_data�transformed_data�
reshaped_data�	n_expertsr$�w_name�datas�xid�ename�merged_namerRs                 �r)r��NemotronHModel.modify_tensors�sq�����=�=�$����9[�)\�)\��Z�Z��Q�'��*�F��-�-�C��/�/�3�3�D�9�G�.5�7�>�>�c�>�*�=M�c�U�RS�TZ�S[�;\�D��;�;�;�3�?��}�}�A�B�B�$�3�3�D�d�P�P�P���}�}�_�-�-��<�<�	�9�=��$�3�3�D�h�T�T�T���}�}�2�3�3� *� 2� 2� 4�
�$�3�3�D��S�S�S���}�}�]�+�+�$)�I�I�j�$9�#9� � 0� 8� 8� :� B� B�2�q� I�
�$�3�3�D��S�S�S���}�}�Y�'�'� *� 2� 2� 4� <� <�R�� C�
�$�3�3�D��S�S�S���}�}�0�1�1� *� 2� 2�4�<�<�� D�
�$�3�3�D��S�S�S���y�y��)�R�/� �L�L�);�<�	���&���=�=�(�16�t�7G�7G�1H�$I�1H�A�R�1H�$I�D�M�+5�
�
�c�"�4�(��t�}�}�S�)�*�i�!�m�;�":��.0��#(��#3�C�&6�s�e�?�3�%�q�QW�PX�X_�$`�E�!�L�L����s�);�E�)B�C� $�
�
�c� 2�5� 9�$4�86&+�[�[��A�%>�87�(5�c�U�-��x�w�&W��#,�#;�#;�D�k�[^�#_�_�_�#;����7�)�*�C�@�@�@�qQ�88U�89T�T�90T�91T��%J�"`�92	A�s��CO�N4�AO�N7�AO�N:�A,O�N=�AO�O�AO�*O�+AO�>O�	CO�O�O�.O
�/O�7O�:O�=O�O�O�O�
O���>�[TU]5 URbPURVVs/sHoR5Ho"PM M nnn[	U5S:�a[SU35eggs snnf)Nr�Unprocessed experts: )rK�prepare_tensorsr��keysr�r)r(�d�k�expertsrRs    �r)r��NemotronHModel.prepare_tensors�sh���
���!��=�=�$�"&�-�-�B�-�Q����A�q��q�-�G�B��7�|�a�� �#8��	�!B�C�C� �%��Bs� A.)93r�r�r�r�r�r*r�r�r�rr�)r#r�r�)r�r�r�r��__doc__r
r��94NEMOTRON_Hr�r��__annotations__�supports_mtp_exportr�rr�rqr,rLr�r�r�r�r�r�r�s@r)r�r��s����3����+�+�J��F�D����7j�rJ��3��3�"95M�(`�T@5�F0Q�/P�/R�/c�/[���CA�JD�Dr,r�)�96__future__r�typingrrrrr�r�baser97rrr
r�graniter�registerrr�r�r�r,r)�<module>r�s���"�9�9����A�A�'�������C&�K�C&�	�C&�L���)�*�&A�I�&A�+�&A�R���*�+�gD�'�gD�,�gDr,
Brunobkr/llama.cpp_AlgMor24_github · Team Ai