codekingpro/portable-devtools
114k
1�
2 ��jS �
� � % S SK Jr SSKJr SSKJr 0 SS_SS_SS_S S_S3S_S S_S S_S
S_SS_SS_SS_SS_SS_SS_SS_SS_SS_rS\S' 0 SS_S S_S S_S S_S S_S S_S!S_S"S_S#S_S$S_S%S_S&S_S'S_S(S_S)S_S*S+_S,S+_0 S-S._S/S._S0S._S1S._S2S._S3S._S4S._S5S._S6S+_S7S+_S8S+_S9S+_S:S+_S;S+_S<S=_S>S=_S?S._ES.S.S.S.S.S.S.S.S.S@S@SA. ErS\SB' SFSC jr SGSD jr4gE)H� )� annotations� )�Encoding)� get_encodingzo1-�5o200k_basezo3-zo4-mini-zgpt-5-zgpt-4.5-zgpt-4.1-z chatgpt-4o-zgpt-4o-zgpt-4-� cl100k_basezgpt-3.5-turbo-z
gpt-35-turbo-zgpt-oss-�
o200k_harmonyz ft:gpt-4ozft:gpt-4zft:gpt-3.5-turbozft:davinci-002zft:babbage-002zdict[str, str]�MODEL_PREFIX_TO_ENCODING�o1�o3zo4-minizgpt-5zgpt-4.1zgpt-4ozgpt-4z
gpt-3.5-turbozgpt-3.5z gpt-35-turboz davinci-002z babbage-002ztext-embedding-ada-002ztext-embedding-3-smallztext-embedding-3-largeztext-davinci-003� p50k_baseztext-davinci-002ztext-davinci-001� r50k_baseztext-curie-001ztext-babbage-001z text-ada-001�davinci�curie�babbage�adazcode-davinci-002zcode-davinci-001zcode-cushman-002zcode-cushman-001z
davinci-codexz
cushman-codexztext-davinci-edit-001� p50k_editzcode-davinci-edit-001ztext-similarity-davinci-001�gpt2) ztext-similarity-curie-001ztext-similarity-babbage-001ztext-similarity-ada-001ztext-search-davinci-doc-001ztext-search-curie-doc-001ztext-search-babbage-doc-001ztext-search-ada-doc-001z code-search-babbage-code-001zcode-search-ada-code-001r zgpt-2�MODEL_TO_ENCODINGc �� � SnU [ ; a6 [ U nO7[ R 5 H u p#U R U5 ( d M Us $ Uc [ SU S35 SeU$ )zjReturns the name of the encoding used by a model.7 8Raises a KeyError if the model name is not recognised.9Nz Could not automatically map z_ to a tokeniser. Please use `tiktoken.get_encoding` to explicitly get the tokeniser you expect.)r r10 �items�11startswith�KeyError)�12model_name�
encoding_name� model_prefix�model_encoding_names �TD:\code\apps\devtools\python\user_packages\Python313\site-packages\tiktoken/model.py�encoding_name_for_modelr X s� � �13 �M��&�&�)�*�5�
�14 2J�1O�1O�1Q� -�L��$�$�\�2�2�*�*� 2R� � ��*�:�,� 7]�
]�15� � �16 �� c �* � [ [ U 5 5 $ )z^Returns the encoding used by a model.17 18Raises a KeyError if the model name is not recognised.19)r r )r s r �encoding_for_modelr" q s � �20 �/�21�;� <�<r N)r �str�returnr# )r r# r$ r ) �22__future__r �corer �registryr r23 �__annotations__r r r" � r r �<module>r* s� �� "� � "�,� �<�,� �<�,� � �,�24
�l� ,� � �
,� � �,� �<�,� �|�,�
�m�,� �m�,� �]�,� ��,� � � ,� �
�!,�" �
�#,�$ �m�%,�& �m�',� �.� �,8%��,�8%� �,�8%� �|� 8%� �\�
8%� �|�8%�
�l�8%� �]�8%� �]�8%� �}�8%� �M�8%� �=� 8%� �=� 8%�" �m�#8%�$ �m�%8%�& �m�'8%�, � �-8%�. � �/8%�0 � �18%�2 �k�38%�4 � �58%�6 �K�78%�8 �{�98%�: �[�;8%�< �{�=8%�> 25�;�?8%�B � �C8%�D � �E8%�F � �G8%�H � �I8%�J �[�K8%�L �[�M8%�P �[�Q8%�R �[�S8%�V "�;�W8%�X "-�#.� *�#.�!,�#.� *�$/� +� �
�o8%� �>� 8�v�2=r