Team Ai
Datasetpublic

codekingpro/portable-devtools

sourceHugging Faceupdated 5mo agoView on Hugging Face
1likes14kdownloads
_tokenizer.cpython-313.pyc94 linesDownload Raw Back to __pycache__
1�

2�j���%SSKJr SSKrSSKrSSKJr SSKJrJrJ	r	 SSK3Jr \"SS55r"S	S4\
5r0S\R"S5_S
\R"S5_S\R"S5_S\R"S5_S\R"S5_S\R"S5_S\R"S\R 5_S\R"S5_S\R"S5_S\R"S5_S\R"S 5_S!\R"S"\R 5_S#\R"\R"\R \R$-5_S$\R"S%5_S&\R"S'5_S(\R"S)5_S*\R"S+5_\R"S,5\R"S-5\R"S.5S/.ErS0\S1'"S2S35rg)4�)�annotationsN)�	dataclass)�	Generator�Mapping�NoReturn�)�	Specifierc�4�\rSrSr%S\S'S\S'S\S'Srg)	�Token��str�name�text�int�position�N)�__name__�5__module__�__qualname__�__firstlineno__�__annotations__�__static_attributes__r��FD:\code\apps\devtools\python\Lib\site-packages\packaging/_tokenizer.pyrrs��6
�I�7
�I��Mrrc�J^�\rSrSrSrSU4SjjrSSjrSrU=r$)�ParserSyntaxError�z7The provided source text could not be parsed correctly.c�F>�X0lXlX l[TU]5 g)N)�span�message�source�super�__init__)�selfr r!r�	__class__s    �rr#�ParserSyntaxError.__init__s����	�����
���rc��SURS-SURSURS-8--S-nURSURSU3$)N� r�~r�^z9    )rr r!)r$�markers  r�__str__�ParserSyntaxError.__str__"sW���t�y�y��|�#�c�T�Y�Y�q�\�D�I�I�a�L�-H�&I�I�C�O���,�,��v�d�k�k�]�&���A�Ar)r r!r)r r
r!r
rztuple[int, int]�return�None)r.r
)	rrrr�__doc__r#r,r�
__classcell__)r%s@rrrs=���A�����	�10��11�
�B�Brr�LEFT_PARENTHESISz\(�RIGHT_PARENTHESISz\)�LEFT_BRACKETz\[�
RIGHT_BRACKETz\]�	SEMICOLON�;�COMMA�,�
QUOTED_STRINGzk12            (13                ('[^']*')14                |15                ("[^"]*")16            )17        �OPz(===|==|~=|!=|<=|>=|<|>)�BOOLOPz\b(or|and)\b�INz\bin\b�NOTz\bnot\b�VARIABLEa�18            \b(19                python_version20                |python_full_version21                |os[._]name22                |sys[._]platform23                |platform_(release|system)24                |platform[._](version|machine|python_implementation)25                |python_implementation26                |implementation_(name|version)27                |extras?28                |dependency_groups29            )\b30        �	SPECIFIER�ATz\@�URLz[^ \t]+�31IDENTIFIERz\b[a-zA-Z0-9][a-zA-Z0-9._-]*\b�VERSION_PREFIX_TRAILz\.\*z\+[a-z0-9]+(?:[-_\.][a-z0-9]+)*z[ \t]+�$)�VERSION_LOCAL_LABEL_TRAIL�WS�ENDzdict[str, re.Pattern[str]]�
DEFAULT_RULESc��\rSrSrSrSSjrSSjrSS.SSjjrSSjrSS	jr	S32S33S.SSjjr34\RSS
j5r
Srg35)�	Tokenizer�[zxContext-sensitive token parsing.36 37Provides methods to examine the input stream to check whether the next token38matches.39c�8�XlX lSUlSUlg)Nr)r!�rules�40next_tokenr)r$r!rNs   rr#�Tokenizer.__init__bs�����41�(,�����
rc�R�URU5(aUR5 gg)z8Move beyond provided token name, if at current position.N)�check�read)r$rs  r�consume�Tokenizer.consumems���:�:�d����I�I�K�rF)�peekc�@�URbSU<SUR<35eXR;dSU<35eURUnURURUR5nUcgU(d[XSUR5Ulg)z�Check whether the next token has the provided name.42 43By default, if the check succeeds, the token *must* be read before44another check. If `peek` is set to `True`, the token is not loaded and45would need to be checked again.46zCannot check for z, already have zUnknown token name: FrT)rOrN�matchr!rr)r$rrV�47expressionrXs     rrR�Tokenizer.checkrs������&�	48���x��t���6I�J�	49�&��z�z�!�B�%9�$��#B�B�!��Z�Z��%�50�� � ����d�m�m�<���=���#�D��(�D�M�M�B�D�O�rc�v�URU5(dURSU35eUR5$)zcExpect a certain token name next, failing with a syntax error otherwise.51 52The token is *not* read.53z	Expected )rR�raise_syntax_errorrS)r$r�expecteds   r�expect�Tokenizer.expect�s7��54�z�z�$����)�)�I�h�Z�*@�A�A��y�y�{�rc��URnUceU=R[UR5-
slSUlU$)z%Consume the next token and return it.N)rOr�lenr)r$�tokens  rrS�Tokenizer.read�s9������� � � ��
�
��U�Z�Z��(�
�����rN)�55span_start�span_endc�p�UcUROUUcUROU4n[UURUS9e)z.Raise ParserSyntaxError at the given position.)r!r)rrr!)r$r rdrers     rr\�Tokenizer.raise_syntax_error�sC��(�/�D�M�M�Z�%�-�D�M�M�8�56�� ���;�;��57�	58rc#�# �URU5(aURnUR5 OSnSv� UcgURU5(dURSUSUSU3US9 UR5 g7f)NzExpected matching z for z, after )rd)rRrrSr\)r$�59open_token�close_token�around�
open_positions     r�enclosing_tokens�Tokenizer.enclosing_tokens�s����:�:�j�!�!� �M�M�M��I�I�K� �M�
�� ���z�z�+�&�&��#�#�$�[�M��z�l�(�6�(�S�(�
$�
�60	
�	�	��s�A>B)rOrrNr!)r!r
rNzMapping[str, re.Pattern[str]]r.r/)rr
r.r/)rr
rV�boolr.ro)rr
r]r
r.r)r.r)r r
rd�61int | Nonererpr.r)rir
rjr
rkr
r.zGenerator[None, None, None])rrrrr0r#rTrRr^rSr\�62contextlib�contextmanagerrmrrrrrKrK[s����	��	�-�		�6364�	��6505��*��"&�#�66��67��	68�69�70�71�
72�$������,/��<?��	$���rrK)�73__future__rrq�re�dataclassesr�typingrrr�74specifiersr	r�	Exceptionr�compile�VERBOSE�_specifier_regex_str�75IGNORECASErIrrKrrr�<module>r}s-��"��	�!�/�/�!������B�	�B�*1-���76�77�5�)�1-�����E�*�1-��B�J�J�u�%�1-��R�Z�Z��&�	1-�78����D�!�1-��R�Z�Z��
�
1-��R�Z�Z�	�	�79�80�	�1-�"	�"�*�*�0�811�#1-�$
�b�j�j��)�%1-�&	�"�*�*�Y�82�'1-�(83�2�:�:�j�!�)1-�*��84�85�
	�	�86�87��+1-�L�����&�&�88�89�90�R�]�]�"��M1-�T	�"�*�*�U�91�U1-�V92�2�:�:�j�!�W1-�X�"�*�*�>�?�Y1-�Z�B�J�J�w�/�[1-�\"$���,N�!O�93�*�*�Y�94�
�:�:�d��a1-�
�)�1�hf�fr
codekingpro/portable-devtools · Team Ai