melghorab/code-assistant
0
1o
2 ���g�1 � @ s� d dl Z d dlZd dlmZ d dlmZmZ d dlZd dlZd dl m3Z4 d dl m Z m
Z
mZ d dlmZmZ d dlmZ d dlmZ d d lmZ d d5lmZmZ d d lmZ d d lmZm Z d d
l m Z d dlZd dl m Z m!Z!m"Z" d dl#m$Z$ d dl%m&Z& d dl'mZ d dl(m)Z) d dl*m+Z+m,Z, d dl-Z.d dl/Z/d dl0Z0d dl1T d dl2m3Z3m4Z4 d dl5m6Z6m7Z7m8Z8 d dl9m:Z: de j;d< da<da=da>da?da(e.j@dd� �Z@e.jAde.jBfd d ��ZAe.jCd d � �ZCdS ) � N)�6itemgetter)�List�Dict)�7ChatOpenAI)�START�8StateGraph�END)r � TypedDict��Document)�ChatPromptTemplate)�StrOutputParser)�Tool�tool)�ToolNode)r � Annotated)� add_messages)� BaseMessage� HumanMessage� AIMessage)�Qdrant)�OpenAIEmbeddings)� QdrantClient)�Distance� VectorParams)�*)� search_pypi�
write_to_docx)�describe_imports� main_prompt�documenter_prompt)�9AgentStatez�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�OPENAI_API_KEYc � s �t jdd��� I d H d S )Nz_Welcome to the Python Code Documentation Assistant! Please upload a Python file to get started.��content)�cl�Message�send� r( r( �D/home/melghorab/maven_nlp_course/code/Project/Code_Documenter/app.py�
on_chat_start5 s �r* �messagec + 10 � s �| j �r1tdd� | j D ���r1dd� | j D �}|d }|j�d�p,|j�d�p,|jdk}|�r$tjd d11�}|�� I d H t d |� d �� t12� � }t j
�||j�}t|j
d
��&}|�� }t|d��
} | �|� W d � n1 sqw Y W d � n1 s�w Y |a�zxt|�}13t|14|�} t d� tg} tdd�}
t�dtfdg�}td�td�d�|B |
B t� B � t d� � fdd�}t | �}t t �}|� d|� |� d|� |� d� d d � }|�!d|� |�"dd� |�#� }t d � d d t$�%d!| d��d"�gi}d#|_&|�'� I d H tjd#d15�}|�� I d H |�(|�}t)d$�a*t+d%d�}d&}t*j,d't-|t.j/d(�d)� t0t*d'|d*�a1|d d+ j&}d,d,|d-�g}d.d� |D �}t1�2|� t1j3d/d0id1�}t d2� tdd�} t�dt4fg�} d3td3�i| B | B t� B } t d4� d'} t*j5| d5d6�d } | d j6}!d7|!d8 d9 � d:|!d8 d; � d<|!d8 d= � �}"t d>� | �(d3|"i�}#t d?� t7|#�a8t d@� tdddA�}$t�dt9fdBg�}%tdC�|B td�tdC�dD�|%B |$B t� B a:t dE� tj;dFt8dGdH�g}&t dI� dJ|_&|&|_ |�'� I d H W d S t<�y# }' zdKt=|'�� �|_&|�'� I d H W Y d }'~'d S d }'~'ww tjdLd16��� I d H d S t�r�t:�r�| j&}(tjdMd17�}|�� I d H zdN|(dO�})t:�(|)�}*|*|_&|�'� I d H W d S t<�y� }' zdPt=|'�� �|_&|�'� I d H W Y d }'~'d S d }'~'ww tjdQd18��� I d H d S )RNc s s � | ]}|j d kV qdS )�fileN��type��.0�elr( r( r) � <genexpr>= s � z on_message.<locals>.<genexpr>c S s g | ] }|j d kr|�qS )r, r- r/ r( r( r) �19<listcomp>> s z on_message.<locals>.<listcomp>r z
text/x-pythonz.pyz20text/plainz Processing your Python file...r# zfile element 21 z 22�rb�wbzDone reading filez gpt-4o-mini)�model�system)�humanz {imports}�
code_language�imports�r9 r: zdone defining imports chainc sD | d d }t �|j�}|d |d d�}� �|�}dt|d�giS )N�messages�����r9 r: r; r# )�json�loadsr$ �invoker )�state� last_messager$ Z chain_input�response�Zdescribe_imports_chainr( r) �call_imports_chainr s �23z&on_message.<locals>.call_imports_chainZ
imports_agent�imports_actionc S s | d d }|j r dS tS )Nr< r= rF )�24tool_callsr )rA rB r( r( r) �should_continue� s z#on_message.<locals>.should_continuezcompiled imports graphr< r8 �python)�roler$ z3Analyzing your code and generating documentation...z:memory:ztext-embedding-3-smalli Zdescription_rag_data)�size�distance)�collection_nameZvectors_config)rM Z25embeddingsr= zImported Packages)r. �namer$ c S s8 g | ]}t |d � d|d � d|d � �i |�d��qS )r. z - rN r$ )Z page_content�metadatar26 )r0 �chunkr( r( r) r3 � s � ���k� )Z
search_kwargszdone adding docs to DB�contextz done defining documenter chaini� )rM �limitztype: rO r. z 27name: rN z 28content: r$ z done extracting chunks form DBz5done invoking documenter chain and will write in docxzdone writing docx file)r6 � temperature)r8 z{query}�query)rS r9 rV zdone defining main chainzdocumentation.docx�inline)rN �path�displayzdone defining elementsuz ✅ Your Python file has been processed! You can download the documentation file below. How can I help you with your code?u ❌ Error processing file: z"Please upload a Python (.py) file.z Thinking...�Python)r9 rV u$ ❌ Error processing your question: z:Please upload a Python file first before asking questions.)>�elements�any�mime�29startswithrN �endswithr% r& r' �print�tempfile�mkdtemp�osrX �join�open�read�write�processed_file_pathZread_python_fileZextract_importsr r r �
from_messagesr r r
r r r! Zadd_nodeZset_entry_pointZadd_conditional_edgesZadd_edge�compiler> �dumpsr$ �updater@ r �
qdrant_clientr Zcreate_collectionr r ZCOSINEr � vectorstoreZ
add_documentsZ as_retrieverr �scroll�payloadr �document_file_pathr �30main_chain�File� Exception�str)+r+ Z
file_elementsZ file_elementZis_python_file�msgZtemp_dir� file_pathZ source_fileZfile_content_bytesZdestination_fileZ file_contentr: Zsearch_packages_toolsZdescribe_imports_llmZdescribe_imports_promptrE Zimports_tool_nodeZuncompiled_imports_graphrH Zcompiled_imports_graphZ
initial_state�resultZembedding_modelZ
embedding_dim�text�chunks�docsZqdrant_retrieverZdocumenter_llmZdocumenter_llm_promptZdocumenter_chainrM Z31all_pointsZ one_chunkZ32input_textZdocument_responseZmain_llmZmain_llm_promptr[ �eZ33user_input�inputsrC r( rD r) �34on_message9 s6 � 35�� �� �3637����� 38� ��� 3940 �41��4243�44����45. ������� �� �46 �� r~ c C s6 t rtj�tj�t ��rt�tj�t �� d S d S d S )N)rh rc rX �exists�dirname�shutil�rmtreer( r( r( r) �on_stop8 s �r� )Drc �getpass�operatorr �typingr r r> �requestsZlangchain_openair Zlanggraph.graphr r r �typing_extensionsr Zlangchain_core.documentsr �langchain_core.promptsr Z langchain.schema.output_parserr
Zlangchain_core.toolsr r Zlanggraph.prebuiltr r Zlanggraph.graph.messager �langchain_core.messagesr r r Zlangchain.vectorstoresr Zlangchain.embeddingsr �langchain.schemarm r Zqdrant_client.http.modelsr r �chainlitr% ra r� Z
code_analysis�toolsr r �promptsr r r Zstatesr! �environrh rq rn rr r* r~ r& r� r( r( r( r) �<module> sV 4748