Goodguygregory93/ai-agents-certification-code
0
1�
2 ��h< � �L � S SK Jr S SKrS SKJr S SKJr S SKr " S S5 rg)� )�DocumentN)� FunctionTool)�
BM25Retrieverc �f � \ rS rSrS S jrS\\ S\\ 4S jrS S\\ 4S jjr3S\S\4S jr S r g4) � Retriever� c �� � Xl U R U5 U l [ R " U R S9U l [ R " U R 5 U l g)aq 5Ingests the similar questions for the GAIA agent to leverage and supports 6the exporting of the FunctionalTool for an AgentWorkFlow to leverage7 8This class handles the detailed logic. of connecting the 9similar questions and answers for the agent to retrieve10 11Details:12 leverages the BM25Retriever due to it's ability to search without pre-embedding Documents13 14)�nodesN) � confirm_load�load_similar_questions�
question_datar �
from_defaults�bm25_retrieverr �get_similar_question�similar_question_tool)�selfr s �G/Users/gregwitt/Github/clones/ai-agents-certification-code/retriever.py�__init__�Retriever.__init__ sO � � )�� !� 8� 8� � F��� +� 9� 9��@R�@R� S���%1�%?�%?��@Y�@Y�%Z��"� � questions�returnc � � / nU H5 n[ R " U5 nUS S:X d M$ UR U5 M7 U$ )a 15filters the incoming questions determining which ones are "level-1" and are potentially 16associated with the challenge.17 18Args:19 questions (list[dict]): question objects to filter20Returns:21 filtered_questions (list[dict]): level 1 questions for similarity22�Level� )�json�loads�append)r r �filtered_questions�question�
question_dicts r �filter_questions�Retriever.filter_questions sE � � ��!�H� �J�J�x� 0�M� �W�%��*�"�)�)�-�8� "� "�!r c � � [ SS5 nUR 5 nU R U5 n[ [ U5 5 Vs/ s H5 n[ SR
SXE S 3SXE S 3/5 SXE S 0S239PM7 nnU( a< U H6 n[ [ R R S UR 3- 5 M8 U$ s snf ) a; 24loads the GAIA dataset for similar questions and returns them as a list of Documents 25for the BM25Retriever26 27Args:28 confirm_load (bool): boolean value that controls the printed output of each appended question29 30Returns:31 docs (list[Document]): returns the Document object for each question for the Retriever32z./data/metadata.jsonl�r�33z34question: �Questionzfinal_answer: z Final answer�question_number�task_id)�text�metadatau ✅ Added Question: ) �open� readlinesr" �range�lenr �join�print�colorama�Fore�GREENr+ )r r �questions_file�incoming_questionsr �i�docsr s r r � Retriever.load_similar_questions1 s� � � � 5�s�;�� +� 5� 5� 7�� !� 2� 2�3E� F�� �S�!3� 4�5�35� 6�!�
��Y�Y� �!3�!6�z�!B� C�D�$�%7�%:�>�%J�$K�L� � � ,�-?�-B�9�-M�N�
� 6�
� 36� � ���h�m�m�)�)�.B�8�CT�CT�BU�,V�V�W� !� � ��#37s �<C�queryc � � U R R U5 nU( a. SR USS Vs/ s H o3R PM sn5 $ gs snf )a= 38queries the `bm25_retriever` to determine if the question given in the query39exists in the potential_questions40 41Args:42 query (str): string of the potential question that might be supplied for the GAIA Agent43Returns:44 response (str): a string response that will indicate if the user(s) exist in the guest_book.45z/n/nN� z-No matching results in the questions database)r �retriever0 r* )r r: �
found_results�docs r r � Retriever.get_similar_questionU sO � � �+�+�4�4�U�;�
� ��;�;�M�"�1�4E� F�4E�S���4E� F�G� G�B�� Gs �A)r r r
r N)F)
�__name__�46__module__� __qualname__�__firstlineno__r �list�str�dictr" r r r �__static_attributes__� r r r r sJ � �[�&"�$�s�)� "��T�47� "�*"�D��N� "�HC�#� C�#� Cr r ) �llama_index.core.schemar r2 �llama_index.core.toolsr �llama_index.retrievers.bm25r r r rI r r �<module>rM s" �� ,� � /� 5� �\C� \Cr