Apppublic
aravagarwal/CodeCloakPII

sourceHugging Faceupdated 3y agoView on Hugging Face
0likes
rootanoninterface__pycache____init__.cpython-310.pyc
__init__.cpython-310.pyc20 linesDownload Raw Back to __pycache__
1o

2���ed�3@sRddlmZddlmZddlZddlZddlZddlZddlmZ	ddl4mZddlm
Z
mZmZmZddlmZmZddlmZmZdd	lmZmZdd5lmZddlmZddlZddlZe�dd
dg�edd�Zedd�Ze�Z e �!e�dddd�gdgdddidd�dd�dd�dd�dd�d d �d!d!�d"d�d#d�d$d�d%d�d&d'�d(d)�d*d�d+d�d,d�d-d�id.d�d/d�d0d�d1d�d2d�d3d�d4d�d5d�d6d�d7d�d8d�d9d�d:d�d;d�d<d�d=d�d>d��d?�d@�Z"dAZ#dBZ$ee"dC�Z%e%�&�Z%e#e%j'd_(e
e%dD�Z)e�Z*dEZ+edFe+dGdH�Z,edIe,gdJ�Z-e)j.�/e-�e�Z0dS)K�)�Language)�ParserN)�Optional)�Counter)�AnalyzerEngine�BatchAnalyzerEngine�Pattern�PatternRecognizer)�TransformersNlpEngine�NlpEngineProvider)�AnonymizerEngine�BatchAnonymizerEngine)�OperatorResult�OperatorConfig)r	)�tqdmzbuild/my-languages.sozlib/tree-sitter-javazlib/tree-sitter-python�java�python�spacy�en�en_core_web_trf)�	lang_code�6model_name�O�simple��expand�PER�PERSON�LOC�LOCATION�ORG�ORGANIZATION�AGE�ID�EMAIL�PATIENT�STAFF�HOSP�PATORG�DATE�	DATE_TIME�PHONE�PHONE_NUMBER�HCW�HOSPITAL�	FIRSTNAME�FULLNAME�NAME�GENDER�DISPLAYNAME�7MIDDLENAME�ACCOUNTNAME�CARDINAL�FAC�PRODUCT�WORK_OF_ART�QUANTITY�LANGUAGE�PERCENT�TIME�ORDINAL�MONEY�GPE�NORP)�labels_to_ignore�aggregation_strategy�stride�alignment_mode� model_to_presidio_entity_mapping)�nlp_engine_name�models�ner_model_configurationi@B�d)�nlp_configuration)�8nlp_enginez�(?!https?://)(?:[a-zA-Z]:\\(?:[^\\/:*?"<>|\r\n]+\\)+[^\\/:*?"<>|\s\r\n]*|\/(?:[^\\/:*?"<>|\r\n]+\/[^\\/:*?"<>|\s\r\n]+\/)*[^\\/:*?"<>|\s\r\n]*)�path_patterng�?)�name�regex�score�URL)�supported_entity�patterns)1�tree_sitterrr�json�os�re�warnings�typingr�Opt�collectionsr�presidio_analyzerrrrr	�presidio_analyzer.nlp_enginer9r�presidio_anonymizerrr
�presidio_anonymizer.entitiesrrr�typerr�
build_library�
JAVA_LANGUAGE�PYTHON_LANGUAGE�parser�set_language�
configuration�10MAX_LENGTH�MAX_STRINGS_IN_SAMPLE�provider�
create_engine�nlp�11max_length�analyzer�12anonymizerrOrM�path_re�registry�add_recognizer�REMOVED_SET�rsrs�Y/home/arava/update_feedback_data/text_pii_removal/anoninterface/anoninterface/__init__.py�<module>s��13141516��������	�17���
������������������� �!�"���/181920