Deepvest/ProfilingAI
0
1o
2 @�g� � @ s� d dl mZ d dlZd dlZd dlZd dlZd dlZd dlZd dlm Z m3Z4m Z d dl m Z m
Z
d dlmZ d dlmZmZmZmZmZmZmZ d dlZd dlZd dlm Z m Z zd dlm Z W n e yi Y nw z5d d l m!Z!m"Z" W n e y} Y nw ej#ej$d6d � e�%d �Z&e7G d
d� d��Z'e8G dd� d��Z(e9G dd� d��Z)e10G dd� d��Z*e11G dd� d��Z+e12G dd� d��Z,G dd� d�Z-G dd � d �Z.G d d � d �Z/dS ) � )� annotationsN)�asdict� dataclass�field)�datetime� timedelta)� lru_cache)�Any�Dict�List�Optional�Tuple�Union�Set)�
AutoTokenizer�AutoModelForCausalLM��PhiForCausalLM�� PeftModel�13PeftConfigz4%(asctime)s - %(name)s - %(levelname)s - %(message)s)�level�format�DeepVestc @ s� e Zd ZU dZdZded< dZded< dZd ed14< d Zded < dZ ded
< dZ15d ed< dZ d ed< dZ d ed< dZ
ded< dZd ed< dZded< dZded< dZded< dZded < dZded < d d � ZdS ) �DeepVestConfigz%Configuration for the DeepVest system�financial_profiler_model�str�16model_pathT�bool�use_quantization�d �int�17cache_sizeZ profiles_db�db_path�use_persistent_storage� �default_horizon� �default_risk_tolerance�min_recommendation_count�enable_caching� �18batch_size�parallel_processingF�fetch_market_dataN�
Optional[str]�market_data_api_key�19debug_mode� log_promptsc C s | j rt�d��tj� dS dS )z+Validate configuration after initializationr N)r1 �logging� getLogger�setLevel�DEBUG��self� r9 �5/Users/sandrine/Deepvest_system/src/core/profiling.py�
__post_init__@ s �z DeepVestConfig.__post_init__)�__name__�20__module__� __qualname__�__doc__r �__annotations__r r" r# r$ r& r( r) r* r, r- r. r0 r1 r2 r; r9 r9 r9 r: r " s$ 21 r c @ s� e Zd ZU dZdZded< dZded< dZded< dZded < dZ ded22< d Z23d ed
< dZ ded< e e
d�Zded< e e
d�Zded< e e
d�Zded< dZded< dZded< d$d d �Zd%d d �Zd%d d!�Zd%d"d#�ZdS )&�FinancialAnalysisz2Detailed financial analysis of an investor profile� �?�float�income_stability� �24debt_ratio�savings_capacity� @�emergency_fund_months�
risk_capacityr% r! �investment_horizon皙�����?�liquidity_needs��default_factory�Dict[str, float]�income_sources�fixed_expenses�variable_expensesNz
Optional[int]� credit_scorezOptional[float]� tax_bracket�returnr c 25 C s zmd| j ko dkn | jdkd| j kodkn | jdkd| j ko+dkn | jdkd| j ko;dkn g}| jdurT|�d| j koPdkn � | j duri|�d| j koedkn � t26|�W S t y� } zt �
d|� �� W Y d}~dS d}~ww )z&Validate financial analysis attributesr � Ni, iR z%Error validating financial analysis: F)rD rF rG rI rJ rK rM rT �appendrU �all� Exception�logger�error�r8 � validations�er9 r9 r: �validateV s& �27 28 29��zFinancialAnalysis.validatec C s t | j�� �t | j�� � S )z Calculate total monthly expenses)�sumrR �valuesrS r7 r9 r9 r: �calculate_total_expensesl s ��z*FinancialAnalysis.calculate_total_expensesc C s$ t | j�� �}|dkr
dS | j| S )z0Calculate savings rate as a percentage of incomer )ra rQ rb rG )r8 Z total_incomer9 r9 r: �calculate_savings_rates s 30z(FinancialAnalysis.calculate_savings_ratec C sv d}d}d}d}t dd| jd �}td| jd �}td| jd �}|| j || || || }tdt d|��S ) z.Calculate overall financial health score (0-1)�333333�?� �?rL r rW rB � r' )�maxrF �minrI rG rD ) r8 Zstability_weightZ debt_weightZsavings_weightZemergency_weightZ31debt_scoreZemergency_scoreZ
savings_scoreZ health_scorer9 r9 r: �get_financial_health_scorez s ����z,FinancialAnalysis.get_financial_health_score�rV r �rV rC )r< r= r> r? rD r@ rF rG rI rJ rK rM r �dictrQ rR rS rT rU r` rc rd rj r9 r9 r9 r: rA F s$ 32 333435rA c @ s� e Zd ZU dZdZded< dZded< dZded < ee d36�Z37d ed < d
Z ded< ee d38�Z
ded< ee d39�Zded< ee d40�Zded< ee d41�Zded< ee d42�Zded< d#dd�Zd$dd �Zd%d d �Zd$d d!�Zd"S )&�FamilyAnalysisz%Detailed analysis of family situationrW r! � family_sizer �43dependents� undefinedr �44life_stagerN �45List[Dict]�
future_eventsrE rC �monthly_obligationsrP �insurance_coverage�education_needs�healthcare_needs�Dict[str, Any]�retirement_plans� estate_plansrV r c 46 C s� z4| j dk| jdk| jdktdd� | j�� D ��tdd� | j�� D ��tdd� | j�� D ��g}t|�W S tyO } zt �47d|� �� W Y d}~d S d}~ww )48z#Validate family analysis attributesrW r c s � � | ]}|d kV qdS �r Nr9 ��.0�valuer9 r9 r: � <genexpr>� � � z*FamilyAnalysis.validate.<locals>.<genexpr>c s r| r} r9 r~ r9 r9 r: r� � r� c s r| r} r9 r~ r9 r9 r: r� � r� z"Error validating family analysis: NF) ro rp ru rY rv rb rw rx rZ r[ r\ r] r9 r9 r: r` � s �49��zFamilyAnalysis.validatec C s0 | j t| j�� � t| j�� � t| j�� � S )z#Calculate total monthly obligations)ru ra rv rb rw rx r7 r9 r9 r: �calculate_total_obligations� s � � ��z*FamilyAnalysis.calculate_total_obligations�Optional[Dict]c C s2 | j sdS dd� | j D �}|sdS t|dd� d�S )z Get the next upcoming life eventNc S s g | ]}d |v r|�qS )�dater9 )r r_ r9 r9 r: �50<listcomp>� � z6FamilyAnalysis.get_next_life_event.<locals>.<listcomp>c S � | d S �Nr� r9 ��xr9 r9 r: �<lambda>� � z4FamilyAnalysis.get_next_life_event.<locals>.<lambda>��key)rt ri )r8 rt r9 r9 r: �get_next_life_event� s z"FamilyAnalysis.get_next_life_eventc C sv t d| jd d �}t d| jd �}t dt| j�d �}t| j�dkp)t| j�dk}|r.dnd}t d|| | | �S )z+Calculate family situation complexity (0-1)rW rL rB 皙�����?re 皙�����?r )ri ro rp �lenrt rx rw )r8 Zbase_complexityZdependent_complexityZevents_complexityZ
special_needsZspecial_complexityr9 r9 r: �calculate_family_complexity� s z*FamilyAnalysis.calculate_family_complexityNrk rl )rV r� )r< r= r> r? ro r@ rp rr r �listrt ru rm rv rw rx rz r{ r` r� r� r� r9 r9 r9 r: rn � s 51 525354 rn c @ s� e Zd ZU dZeed�Zded< eed�Z ded< eed�Z55ded< eed�Z d ed56< eed�Z ded < eed�Z
ded < eed�Zded
< eed�Zded< d*dd�Zd+dd�Zd,dd�Zd+dd�Zd-d d �Zd.d/d#d$�Zd0d'd(�Zd)S )1�InvestmentGoalszDetailed investment goalsrN rs �
primary_goals�Dict[str, int]�57timeframesrP �required_returns� List[str]�priority_order�target_amounts�
goal_progress�risk_tolerance_by_goalzDict[str, List[Dict]]�58milestonesrV r c 59 C s� zK| j rtdd� | j �� D ��rW dS | jr%tdd� | j�� D ��r%W dS | jr7tdd� | j�� D ��r7W dS | jrItdd� | j�� D ��rIW dS W dS tyf } zt�d|� �� W Y d }~dS d }~ww )60z$Validate investment goals attributesc s s � | ]}|d k V qdS r} r9 )r �amountr9 r9 r: r� � r� z+InvestmentGoals.validate.<locals>.<genexpr>Fc s � � | ] }|d k p |dkV qdS )������ Nr9 )r �retr9 r9 r: r� � � � c s r� )rW r% Nr9 )r �tolr9 r9 r: r� � r� c s r� )r rW Nr9 )r �progr9 r9 r: r� � r� Tz#Error validating investment goals: N) r� �anyrb r� r� r� rZ r[ r\ �r8 r_ r9 r9 r: r` � s ��zInvestmentGoals.validaterC c C s t | j�� �S )z.Calculate total target amount across all goals)ra r� rb r7 r9 r9 r: � calculate_total_target_amount� s z-InvestmentGoals.calculate_total_target_amountr/ c C s | j r| j d S dS )z Get the highest priority goalr N)r� r7 r9 r9 r: �get_highest_priority_goal� s z)InvestmentGoals.get_highest_priority_goalc sF � j r� jsdS � �� ��dkrdS t� �fdd�� j�� D ��}|S )z0Calculate risk tolerance weighted by goal amountrH r c 3 s* � | ]\}}� j �|d �| � V qdS )r' N)r� �get)r �goalr� �r8 Z total_amountr9 r: r� s61 � �62�zDInvestmentGoals.calculate_weighted_risk_tolerance.<locals>.<genexpr>)r� r� r� ra �items)r8 Zweighted_tolerancer9 r� r: �!calculate_weighted_risk_tolerance s �z1InvestmentGoals.calculate_weighted_risk_tolerance�goal_idr c C s, || j vs63|| jvr dS | j| | j | S )z1Calculate progress percentage for a specific goalrE )r� r� )r8 r� r9 r9 r: �calculate_goal_progress s z'InvestmentGoals.calculate_goal_progress�Z �daysr! c C s� g }t �� }|t|d� }| j�� D ]%\}}|D ] }|�d�}|r6|| kr+|kr6n q|�d|i|�� qqt|dd� d�S )z-Get upcoming milestones within specified days�r� r� r� c S r� r� r9 r� r9 r9 r: r� ' r� z9InvestmentGoals.get_upcoming_milestones.<locals>.<lambda>r� )r �nowr r� r� r� rX �sorted) r8 r� �upcomingr� �cutoffr� r� Z milestoner� r9 r9 r: �get_upcoming_milestones s 64 ����z'InvestmentGoals.get_upcoming_milestones�monthly_contribution�expected_returnc C s� i }| j �� D ]D\}}| j�|d�}| j�|d�d }|dkr$d||< q|d|d | }|d|d | d |d } || }65td|66| �||< q|S )z@Estimate feasibility of goals based on contributions and returnsr �< � rW � �?)r� r� r� r� r� ri ) r8 r� r� � feasibilityr� �targetZcurrent_amount�monthsZfuture_currentZfuture_contributionsZexpected_amountr9 r9 r: �estimate_goal_feasibility) s z)InvestmentGoals.estimate_goal_feasibilityNrk rl )rV r/ )r� r rV rC )r� )r� r! rV rs )r� rC r� rC rV rP )r< r= r> r? r r� r� r@ rm r� r� r� r� r� r� r� r` r� r� r� r� r� r� r9 r9 r9 r: r� � s" 67 6869707172 r� c @ sd e Zd ZU dZded< ded< ded< ded < ded73< d ed < eed
�Zded< eed
�Zded< eed
�Z ded< eed
�Z74ded< eed
�Z ded< eed
�Z ded< ee
d
�Zded< ee
d
�Zded< eed
�Zded< dZded< eed
�Zded< d d � Zd3d d �Zd4d!d"�Zd5d#d$�Zd3d%d&�Zd6d'd(�Zd7d*d+�Zd8d,d-�Zd3d.d/�Zd9d0d1�Z d2S ):�ProfileAnalysisResultz'Complete result of LLM profile analysisrC �75risk_scorer! rK r� r� ry � constraints�recommendationsr � explanationrN rP �risk_decomposition�goal_feasibility�investment_style�market_sensitivity�asset_allocation�geographic_allocation�List[Dict[str, Any]]�alerts�attention_points�market_contextrB �adaptability_score�stress_test_resultsc C s< d| j krdkstd�� td��| jdkr td��dS )z Post-initialization validationr rW �"Risk score must be between 0 and 1z#Investment horizon must be positiveN)r� �76ValueErrorrK r7 r9 r9 r: r; h s �77�z#ProfileAnalysisResult.__post_init__rV c C s< | j dk rdS | j dk rdS | j dk rdS | j dk r dS d S )78z&Determine risk category based on scorerL � Très conservateur皙�����?� Conservateur�333333�?� Modéré皙�����?� Dynamique� Très dynamique�r� r7 r9 r9 r: �get_risk_categoryo s 79808182z'ProfileAnalysisResult.get_risk_categoryc C s dd� | j D �S )zGet critical alerts onlyc S s g | ] }|� d �dkr|�qS )�severity�critical)r� )r Zalertr9 r9 r: r� ~ � z=ProfileAnalysisResult.get_critical_alerts.<locals>.<listcomp>)r� r7 r9 r9 r: �get_critical_alerts| s z)ProfileAnalysisResult.get_critical_alertsc C s dd� | j �� D �S )zIdentify major constraintsc S s, g | ]\}}t |tttf�r|d kr|�qS )�ffffff�?)�83isinstancer r! rC )r �84constraintr� r9 r9 r: r� � s ��z?ProfileAnalysisResult.get_major_constraints.<locals>.<listcomp>)r� r� r7 r9 r9 r: �get_major_constraints� s �z+ProfileAnalysisResult.get_major_constraintsc C s$ | j sdS t| j �� dd� d�d S )z"Determine primary investment styleZBalancedc S r� �NrW r9 r� r9 r9 r: r� � r� zDProfileAnalysisResult.get_primary_investment_style.<locals>.<lambda>r� r )r� rh r� r7 r9 r9 r: � get_primary_investment_style� s z2ProfileAnalysisResult.get_primary_investment_stylec C s" | j sdS t| j �� �t| j � S )z"Calculate overall goal feasibilityrB )r� ra rb r� r7 r9 r9 r: � calculate_overall_feasibility� s z3ProfileAnalysisResult.calculate_overall_feasibility�List[Tuple[str, float]]c C s t | j�� dd� dd�S )z*Get main risk factors sorted by importancec S r� r� r9 r� r9 r9 r: r� � r� z8ProfileAnalysisResult.get_risk_factors.<locals>.<lambda>T�r� �reverse)r� r� r� r7 r9 r9 r: �get_risk_factors� s85 �z&ProfileAnalysisResult.get_risk_factorsc C s4 i }| j �� D ]\}}t| jd| d�||< q|S )z*Evaluate adaptability to market conditionsrW r� )r� r� ri r� )r8 � adaptability� condition� sensitivityr9 r9 r: �get_market_adaptability� s 86�z-ProfileAnalysisResult.get_market_adaptabilityc C s� | � � }d|� �d| jd�d| j� d�ddgdd � | jd87d � D ��d�d �d
d � t| j�� dd� dd�D ��d�d�dd � | �� d88d � D ��d�d�dd � | jd89d � D ��d�d�dd � | j d90d � D ��}d�91|�S )z3Generate a concise one-page summary of the analysisz# Profil d'Investissement: zScore de risque: �.2fz/1.00 | Horizon: z ans� z## Objectifs Principauxc S � g | ]}d |� ��qS ��- r9 )r r� r9 r9 r: r� � � zCProfileAnalysisResult.generate_one_page_summary.<locals>.<listcomp>Nr' u# ## Allocation d'Actifs Recommandéec S �" g | ]
\}}d |� d|d���qS �r� �: �.1%r9 )r �asset�weightr9 r9 r: r� � � " c S r� r� r9 r� r9 r9 r: r� � r� zAProfileAnalysisResult.generate_one_page_summary.<locals>.<lambda>Tr� z ## Facteurs de Risque Principauxc S r� r� r9 )r �factor�scorer9 r9 r: r� � r u ## Recommandations Clésc S r� r� r9 )r �recr9 r9 r: r� � r� z## Points d'Attentionc S r� r� r9 )r �pointr9 r9 r: r� � r� �92) r� r� rK r� r� r� r� r� r� r� �join)r8 �
risk_category�summaryr9 r9 r: �generate_one_page_summary� sF ������93� � �
������94z/ProfileAnalysisResult.generate_one_page_summaryc C sd | j | �� | j| jd�| j| j| j| jd�| j| j | j95d�| j | j | j
d�| j| jd�| j| jd�S )z Convert analysis to dictionary)r �category�
decompositionZ stress_tests)�horizon�styler� r� )r� r� r� )Z suggestionsr� r� )ZassetsZ geography)� risk_profile�investment_profileZgoals_analysisr� Z allocationsr� r� )r� r� r� r� rK r� r� r� r� r� r� r� r� r� r� r� r� r� r7 r9 r9 r: �to_dict� s0 ������z ProfileAnalysisResult.to_dictN�rV r )rV r� )rV r� rl )rV r� �rV rP �rV ry ) r< r= r> r? r@ r rm r� r� r� r� r� r� r� r� r� r� r� r� r; r� r� r� r� r� r� r� r96 r r9 r9 r9 r: r� H s: 97 9899
100101102103104105 106r� c @ s� e Zd ZU dZdZded< eejd�Z ded< eejd�Z107ded< d Z d108ed < d Z d109ed
< dZ
d110ed< d Zd111ed< d Zd112ed< eed�Zded< dZded< eed�Zded< dZd113ed< dZd ed < d Zd ed < d Zd ed < d Zd ed!< d"Zd#ed$< d"Zd#ed%< d"Z d#ed&< d'Z d#ed(< d)Z d114ed*< d"Z d#ed+< d,Z d#ed-< dZ!d.ed/< dZ"d0ed1< dZ#d2ed3< dZ$ded4< eed�Z%d5ed6< eed�Z&d5ed7< eed�Z'd8ed9< dZ(d:ed;< ed<d=� d�Z)ded>< dZ*d?ed@< dAZ+d edB< dAZ,d edC< dAZ-d edD< dEdF� Z.dgdHdI�Z/dJdK� Z0dhdLdM�Z1didNdO�Z2didPdQ�Z3didRdS�Z4didTdU�Z5djdXdY�Z6dkdZd[�Z7dldmd]d^�Z8dndodadb�Z9dpdcdd�Z:e;dqdedf��Z<dS )r�PersonalProfilez<Complete and dynamic investor profile with advanced analysisNr/ �idrN r �115created_at� last_updatedrW r! �versionr' �risk_tolerancer% rK rD �financial_knowledger� �investment_goalsFr �esg_preferencesry r� � �ageg j�@rC �
annual_incomerE � total_assets�116total_debt�monthly_savingsr� r �117occupation�industry�education_level�single�marital_statusr �number_of_dependents�118tax_status�owner�residential_statuszOptional[FinancialAnalysis]�financial_analysiszOptional[FamilyAnalysis]�family_analysiszOptional[InvestmentGoals]�investment_objectives�profile_descriptionrP � risk_metrics�performance_metricsr� �historical_changeszOptional[datetime]� last_reviewc C s g g g g g d�S )N)�
asset_classes�sectors�regionsZ119strategiesZexcluded_investmentsr9 r9 r9 r9 r: r� s �zPersonalProfile.<lambda>�investment_preferencesz Optional[ProfileAnalysisResult]�llm_analysis_resultsrB r� r� �complexity_tolerancec C sV | j du r120| �� | _ | jdu rt� | _| jdu r t� | _| jdu r%t� | _| �� dS )zPost-initialization setupN) r �_generate_profile_idr- rA r. rn r/ r� �_validate_profiler7 r9 r9 r: r; s 121122123124125 z PersonalProfile.__post_init__rV c C sT t | j�t | j�t | j�| jt�� �� g}d�|�}dt �126|� � �� � dd� � �S )zGenerate unique profile ID�_ZPROFILE_N� )
r r r r r$ r r� � isoformatr �hashlib�sha256�encode� hexdigest)r8 �127componentsZ
unique_stringr9 r9 r: r; . s 128�129 z$PersonalProfile._generate_profile_idc
C s� d| j ko130dkn dfd| j kodkn dfd| j ko&dkn dfd| j ko4dkn dfd| j koBd kn d131f| jd kd f| jd kd
f| jd kdfd | j kobdkn dfd | j kopdkn dfd | j132 ko~dkn dfg }| j r�| j � dg �D ] }t
|t�s�td��q�| jr�t| j�d kr�td��|D ]133\}}|s�t|��q�| jr�| j�� s�td��| jr�| j�� s�td��| jr�| j�� s�td��dS dS )z Comprehensive profile validationrW r% z&Risk tolerance must be between 1 and 5�2 z1Investment horizon must be between 1 and 50 yearsz(Income stability must be between 1 and 5z+Financial knowledge must be between 1 and 5� �x z Age must be between 18 and 120r z Annual income cannot be negativez Total assets cannot be negativez Total debt cannot be negativer� z*Adaptability score must be between 0 and 1z,Complexity tolerance must be between 0 and 1r5 zInvalid asset class formatz.At least one investment goal must be specifiedzInvalid financial analysiszInvalid family analysisz Invalid investment objectivesN)r rK rD r r r r! r" r� r� r: r8 r� r� r r� r r� r- r` r. r/ )r8 r^ � asset_class�134validation�messager9 r9 r: r< : s< �135� ��z!PersonalProfile._validate_profilec 136 C s zm| j dkr | j| j ntd�| jr| jjd nd| jr | jjnd| jr+t| j�d nd| �� | � � | �137� | � � d�}| j rJ|�
| j j| j jd�� | jrR| j�� nd}|d d d |d138 d |d |d
< || _|W S ty� } zt�d|� �� i W Y d}~S d}~ww )z$Calculate comprehensive risk metricsr �infrg rB r% )�total_debt_ratioZemergency_fund_ratiorJ Zinvestment_diversificationZdebt_service_ratioZ savings_rateZliquidity_ratioZinvestment_concentration)Zllm_risk_scorer� rJ rW rL re rL Zoverall_risk_capacityz Error calculating risk metrics: N)r r" rC r- rI rJ r r� � _calculate_debt_service_ratio�_calculate_savings_rate�_calculate_liquidity_ratio�#_calculate_investment_concentrationr9 �updater� r� rj r1 rZ r[ r\ )r8 r1 Zfinancial_healthr_ r9 r9 r: �$calculate_comprehensive_risk_metricsb s: � �139�����z4PersonalProfile.calculate_comprehensive_risk_metricsc 140 C s� zI| j r | jdkr W dS t| j jt�r4d| j jv r4t| j jd t�r-t| j jd �� �}n | j jd }n| jd }| jd }|dkrG|| W S dW S tyd } zt �141d|� �� W Y d}~dS d}~ww )z Calculate debt service ratior rE Z
debt_payments�{�G�z�?r� z&Error calculating debt service ratio: N) r- r r� rR rm ra rb r" rZ r[ r\ )r8 Zmonthly_debt_paymentZmonthly_incomer_ r9 r9 r: rM � s 142143��z-PersonalProfile._calculate_debt_service_ratioc 144 C sb z| j r | jdkr W dS | j jd | j W S ty0 } zt�d|� �� W Y d}~dS d}~ww )zCalculate savings rater rE r� z Error calculating savings rate: N)r- r rG rZ r[ r\ r� r9 r9 r: rN � s ��z'PersonalProfile._calculate_savings_ratec 145 C st z | j r | jdkr W dS tdd� | j j�� D ��}|| j W S ty9 } zt�d|� �� W Y d}~dS d}~ww )zCalculate liquidity ratior rE c s s � | ] \}}|d v r|V qdS ))ZsavingsZ investments�cashNr9 )r �type_r� r9 r9 r: r� � s � ��z=PersonalProfile._calculate_liquidity_ratio.<locals>.<genexpr>z#Error calculating liquidity ratio: N)r- r! ra rQ r� rZ r[ r\ )r8 Z
liquid_assetsr_ r9 r9 r: rO � s 146� ��z*PersonalProfile._calculate_liquidity_ratioc 147 C s� z&| j r148| j �d�s
W dS | j d }dt|� gt|� }tdd� |D ��W S tyA } zt�d|� �� W Y d}~dS d}~ww )z,Calculate investment concentration using HHIr5 r� rW c s s � | ]}|| V qd S �Nr9 )r �wr9 r9 r: r� � r� zFPersonalProfile._calculate_investment_concentration.<locals>.<genexpr>z,Error calculating investment concentration: N)r8 r� r� ra rZ r[ r\ )r8 r5 �weightsr_ r9 r9 r: rP � s 149��z3PersonalProfile._calculate_investment_concentration�updates�'PersonalProfile'c 150 C s� z7t | �}| �|� |�� D ] \}}||v r|||< q|d d7 < t�� |d< | jdi |��}|�� |W S tyL } z t� d|� �� � d}~ww )z#Update profile with new informationr rW r zError updating profile: Nr9 )151r �_save_change_historyr� r r� � __class__r< rZ r[ r\ )r8 rY Z current_datar� r� �updated_profiler_ r9 r9 r: rQ � s" 152� ��zPersonalProfile.updatec s: t �� �� |� fdd�|�� D �� jd�}� j�|� dS )zRecord change historyc s" i | ]
}t � |�r|t� |��qS r9 )�hasattr�getattr)r r� r7 r9 r: �153<dictcomp>� s �154�z8PersonalProfile._save_change_history.<locals>.<dictcomp>)� timestamp�changesZprevious_valuesr N)r r� r? �keysr r3 rX )r8 rY Z
change_recordr9 r7 r: r[ � s 155156��157z$PersonalProfile._save_change_historyr c s � r � fdd�| j D �S | j S )z%Get change history for optional fieldc s g | ]158}� |d v r|�qS )rb r9 )r �change�r r9 r: r� � s159 �z6PersonalProfile.get_change_history.<locals>.<listcomp>)r3 )r8 r r9 re r: �get_change_history� s160 161�z"PersonalProfile.get_change_history�filepath�include_detailed_analysisc 162 C s� z?t jt j�|�dd� t|ddd��}tj|r t| �n| �� |ddt d� W d � n1 s0w Y t163� d164|� �� W d S t yW } z t165�
d |� d |� �� � d }~ww )
zExport profile to JSON fileT)�exist_okrW �utf-8��encodingFr� )� ensure_ascii�indent�defaultNz!Profile exported successfully to zError exporting profile to r� )�os�makedirs�path�dirname�open�json�dumpr r r r[ �inforZ r\ )r8 rg rh �fr_ r9 r9 r: � export_json� s � ���zPersonalProfile.export_jsonc C sp | j | j| j�� | j�� | j| j| j| j| j | j166d�| j | j | j
| j| j| jd�| j| jr4| j�� d�S dd�S )z,Convert profile to dictionary representation)r r r! r" r( rp )r rK r rD �goalsr N)r r r r �167basic_infor r1 � llm_analysis)r r r r? r r r r! r" r( r) r rK r rD r r r1 r9 r r7 r9 r9 r: r 168 s. � ���zPersonalProfile.to_dictc 169 C sJ z�t |ddd��
}t�|�}W d � n1 sw Y dD ]}||v r2|| r2t�|| �||< q d|v rF|d rFtd i |d ��|d< d|v rY|d rYtd i |d ��|d< d|v rl|d rltd i |d ��|d< d |v r|d rtd i |d ��|d < | d i |��}|� � |W S t170y� } z t � d171|� d |� �� � d}~ww )
zLoad profile from JSON file�rrj rk N)r r r4 r- r. r/ r9 �Error loading profile from r� r9 )
rt ru �loadr �
fromisoformatrA rn r� r� r< rZ r[ r\ )�clsrg rx �dataZ172date_field�profiler_ r9 r9 r: � from_json% s0 ����zPersonalProfile.from_jsonr r rl )rY ry rV rZ )rY ry rV )r r/ rV r� �F)rg r rh r r )rg r rV rZ )=r< r= r> r? r r@ r r r� r r r r rK rD r r� r r rm r� r r r! r" r# r$ r% r& r( r) r* r, r- r. r/ r0 r1 r2 r3 r4 r8 r9 r� r� r: r; r; r< rR rM rN rO rP rQ r[ rf ry r � classmethodr� r9 r9 r9 r: r � sj 173 174 175(176$177178 179 180181182 183r c @ sv e Zd ZdZd#dd�Zd$dd �Zd%d d �Zd&dd�Zdd� Zd'd(dd�Z d&dd�Z184d)dd �Z d)d d �Z d'd*d!d"�Z
d185S )+� DeepVestLLMzAAdvanced LLM integration using fine-tuned financial advisor model�configr c C sl || _ t�d�| _d| _d| _| �� | _tj �186|j �r"| � |j � n | j�
d|j � d�� i | _|j| _dS )z Initialize with configurationz DeepVest.LLMNz Model path z not found, using fallback mode)r� r3 r4 r[ �model� tokenizer�_detect_optimal_device�devicerp rr �existsr �187load_model�warning�generation_cacher" �max_cache_entries�r8 r� r9 r9 r: �__init__K s 188 zDeepVestLLM.__init__rV r c C sR t j�� r
| j�d� dS tt jd�r!t jj�� r!| j�d� dS | j�d� dS )z-Detect the optimal device for model inferencez CUDA GPU available, using CUDA�cuda�mps� Apple MPS available, using MPSzNo GPU available, using CPU�cpu)�torchr� � is_availabler[ rw r^ �backendsr� r7 r9 r9 r: r� _ s 189 z"DeepVestLLM._detect_optimal_deviceNc C sj �z�|r|n| j j}| j�d|� �� tj�� r!| j�d� d}n ttjd�r6tjj �� r6| j�d� d}n| j�d� d}t190j � |d�}t191j �
|�r�t|d ��
}t�|�}W d192 � n1 s`w Y d |vr�| j�d � d
|d < d|vr|dg|d< t|d��}tj||dd� W d193 � n1 s�w Y n3| j�d|� d�� d
dgddddddd�}t|d��}tj||dd� W d194 � n1 s�w Y ztj|dd �| _tj|dtjd dd �| _W n� t�y� } z�| j�d |� �� z dd lm} tj|dd �| _|j|dtjd dd �| _W ne t�yv } zX| j�d!| � �� z%dd"l m }195m } d#} tj| dtjd d$�}
tj| dd �| _|196�|
|�| _W n# t�yk } z| j� d%|� �� td&|� d'| � d'|� ���d197}~ww W Y d198} ~ nd199} ~ ww W Y d200}~nd201}~ww | jj d202u �r�| jj!| j_ | j�d(� W dS t�y� } z| j� d)|� �� W Y d203}~d*S d204}~ww )+z2Load the fine-tuned model from the configured pathz Loading fine-tuned model from zCUDA available, using GPUr� r� r� z Using CPUr� z config.jsonr} N�205model_typez(Adding missing model_type to config.json�phi�
architecturesr rW r� )rn zconfig.json not found in z, creating onerW r i i � �float16)r� r� Z bos_token_id� eos_token_id� pad_token_idZ hidden_sizeZ206vocab_size� torch_dtypeT)�trust_remote_code�auto)r� r� �207device_mapZlow_cpu_mem_usagez First loading attempt failed: r z Second loading attempt failed: r zmicrosoft/phi-1_5)r� r� r� z)All loading attempts failed. Last error: zCould not load model: z -> zModel loaded successfullyzError loading model: F)"r� r r[ rw r� r� r� r^ r� r� rp rr r r� rt ru r r� rv r Zfrom_pretrainedr� r r� r� rZ � transformersr �peftr r r\ Z pad_tokenZ eos_token)r8 r Z path_to_user� Z config_filerx r� Z model_errorr Zspecific_errorr r Zbase_model_pathZ208base_modelZ209peft_errorr_ r9 r9 r: r� k s� 210 � 211 ��� 212 �� � ���� �����) ��zDeepVestLLM.load_model�promptc C s t �|�� ��� S )z Generate cache key for a prompt)r@ �md5rB rC )r8 r� r9 r9 r: �_get_cache_key� s zDeepVestLLM._get_cache_keyc C sz t | j�| jkr;t| j�� dd� d�}t| jd �}t|�D ]}|t |�k r.| j|| d = q | j�d|� d�� dS dS ) zManage cache sizec S � | d d S �NrW ra r9 r� r9 r9 r: r� � � z+DeepVestLLM._manage_cache.<locals>.<lambda>r� rL r zCache cleanup: removed z entriesN) r� r� r� r� r� r! �ranger[ �debug)r8 Zsorted_entriesZentries_to_remove�ir9 r9 r: �
_manage_cache� s � ��zDeepVestLLM._manage_cache�� �213max_lengthr! c
� s� �| j jr$| �|�}|| jv r$| j| }t�� |d< | j�d� |d S | j jr1| j�d|� �� t | d�r�| j214r�| j r�| j r�zt| j |dddd �}t | j d215�r^| j j
� � fd d �|�� D �}t�� � | j jdi |�|dd
dddd| j jd���}W d � n1 s�w Y | j j|d dd�}d|v r�|�d�d �� }| j jr�|t�� d�| j|< | �� |W S ty� } z| j�d|� �� | �|�I dH W Y d}~S d}~ww | j�d� | �|�I dH S ) z$Generate text using the loaded modelra zUsing cached response�responsezPrompt: � model_loaded�ptT� )�return_tensors�216truncationr� r� c s i | ]217\}}||� � ��qS r9 )�to�r �k�v�r� r9 r: r` � z-DeepVestLLM.generate_text.<locals>.<dictcomp>r� �q=218ףp�?rE �ffffff�?r+ )r� � do_sample� temperature�top_p�top_k�repetition_penaltyZ num_beamsr� Nr �Zskip_special_tokens�[/INST]r� )r� ra zError generating text: �Using fallback generationr9 )r� r* r� r� r r� r[ r� r2 r^ r� r� r� r� r� r� �no_grad�generater� �decode�split�stripr� rZ r\ �_fallback_generationrw ) r8 r� r� � cache_keyZ cache_entry�inputs�outputsr� r_ r9 r� r: �
generate_text� s\ �219220221 222223� � �
� �� zDeepVestLLM.generate_textc � s� �| j �d� d}d}t�d|�}|rt|�d��}t�d|�}|r)t|�d��}|d }d|d�d |� d224t|d �� d td| d
�� dtd| d �� d� }|S )z-Fallback generation when model is unavailabler� r' r% z[Rr]isque.*?(\d+)rW z[Hh]orizon.*?(\d+)z1. Score de risque: r� uZ - Basé sur la tolérance au risque déclarée.2252. Horizon d'investissement recommandé: u� ans.2263. Objectifs prioritaires: Épargne générale, Croissance du capital.2274. Contraintes: Limitation classique de diversification.228 2295. Recommandations d'allocation:230 - Actions: r z%231 - Obligations: �P u %232 - Liquidités: � uQ %233 2346. Recommandations:235 - Diversifier votre portefeuille236 - Investir régulièrement237 - Maintenir une épargne de sécurité suffisante238 2397. Points d'attention:240 - Réévaluer régulièrement votre profil de risque241 - Ajuster votre allocation selon l'évolution de votre situation242 - Prévoir une réserve d'urgence adéquate243)r[ rw �re�searchr! �group)r8 r� r rK Z244risk_matchZ
horizon_matchr� Zfallback_responser9 r9 r: r� 3 s* � 245�246���z DeepVestLLM._fallback_generation� profile_datary c 247 C sL d� g d�|�dd�� �d�|�dd�� �d�|�dd�� �d �|�d248d �� �d �|�d
d�� �d�|�dd�� �d�|�dd�� �d�d� |�dg ��� �d�|�dd�� �d�|�dd�� �d�|�d d�� �d �|�d d�� �d �|�d d!�r|d"nd#� �d$�d� |�d%i ��d&g ��� �d'�d� d(d)� |�d*i ��� D ��� �d+��S ),z)Prepare analysis prompt from profile datar� u� [INST] Je suis un conseiller financier expert. Analyse ce profil d'investisseur de manière exhaustive.249 250Profil détaillé :251- Âge: r � Non spécifié� ans252- Revenu annuel: r � €253- Situation familiale: r( u 254- Dépendants: r) r u 255- Épargne mensuelle: r# u €256- Dette totale: r" u €257- Patrimoine total: r! u €258- Objectifs: �, r u 259- Tolérance au risque (1-5): r r' z 260- Horizon d'investissement: rK r% u) ans261- Connaissances financières (1-5): r � 262- Stabilité professionnelle: rD u 263- Préférences ESG: r FZOuiZNonu 264- Secteurs préférés: r8 r6 u 265- Contraintes spécifiques: c s s � | ] \}}|rt |�V qd S rV )r r� r9 r9 r: r� q r� z6DeepVestLLM.prepare_analysis_prompt.<locals>.<genexpr>r� u� 266 267Format de réponse requis:2681. Score de risque (entre 0 et 1): [score] - Justification détaillée2692. Horizon d'investissement recommandé: [années] - Justification2703. Objectifs prioritaires: Liste ordonnée avec justification2714. Contraintes et limitations: Analyse détaillée des contraintes2725. Recommandations d'allocation:273 - Par classe d'actifs (%)274 - Par zone géographique (%)275 - Par stratégie d'investissement2766. Analyse des risques:277 - Décomposition des risques278 - Points de vigilance279 - Stress tests recommandés2807. Plan d'action détaillé:281 - Court terme (0-2 ans)282 - Moyen terme (2-5 ans)283 - Long terme (5+ ans)2848. Recommandations spécifiques:285 - Investissements recommandés286 - Stratégies de diversification287 - Protection du capital2889. Explication détaillée:289 - Raisonnement complet290 - Points d'attention particuliers291 - Opportunités identifiées292 293Analyse complète: [/INST])r r� r� �r8 r� r9 r9 r: �prepare_analysis_prompt^ s> 294295�296�297�298�299�300�301 �302�303 �304 �305
�306��� �z#DeepVestLLM.prepare_analysis_promptc C s� d|� dd�� d|� dd�� d|� dd�� dd �|� d307g ��� d |� d d
�� d|� dd�� d|� dd
�� d|� dd�� d|� dd�� d|� dd�� d|� dd�� d|� d d
�� d �S ) z,Prepare description prompt from profile datau� [INST] En tant que conseiller financier expert, génère une description détaillée et professionnelle de ce profil d'investisseur.308 309Profil complet:310- Âge: r r� r� r r� r( z311- Objectifs: r� r u 312- Tolérance au risque: r r' z/5313- Horizon: rK r% u# ans314- Connaissances financières: r u /5315- Épargne mensuelle: r# u €316- Patrimoine: r! u
€317- Dette: r" u €318- Secteur d'activité: r% r� rD u� /5319 320La description doit couvrir:3211. Analyse du profil de risque et des objectifs3222. Evaluation de la capacité financière3233. Identification des contraintes et opportunités3244. Recommandations d'investissement personnalisées3255. Points de vigilance et attention particulière3266. Stratégie de diversification recommandée3277. Projection et scénarios d'évolution328 329Description: [/INST]�r� r r� r9 r9 r: �prepare_description_prompt� s2 330�331�332��333�334�335 �336 337�338 �339 �340
�341�z&DeepVestLLM.prepare_description_prompt�promptsr� c
� s �� j r� js� fdd�|D �I dH S g }� jj}tdt|�|�D ]k}|||| � }� j|ddddd�}� fd d342�|�� D �}t�� � � j j di |�|dd d d
d� jj343d���}W d � n1 sdw Y t |�D ] \} }344� jj |345dd�} d| v r�| �
d�d �� } |�| � qmq!|S )z3Generate responses for multiple prompts in parallelc � s �g | ]346}� � |�I d H �qS rV )r� )r r� r7 r9 r: r� � � � z.DeepVestLLM.generate_batch.<locals>.<listcomp>Nr r� Tr� )r� �paddingr� r� c s i | ] \}}||� � j��qS r9 )r� r� r� r7 r9 r: r` � r� z.DeepVestLLM.generate_batch.<locals>.<dictcomp>r� r� rE r� )r� r� r� r� r� r� r� r� r� r� r9 )r� r� r� r, r� r� r� r� r� r� r� � enumerater� r� r� rX ) r8 r� r� � responsesr, r� Z
batch_promptsZ batch_inputsr� �j�outputr� r9 r7 r: �generate_batch� sF � �347348� � � �zDeepVestLLM.generate_batch)r� r r rV )r� r rV r )r� )r� r r� r! rV r �r� ry rV r )r� r� r� r! rV r� )r< r= r> r? r� r� r� r� r� r� r� r� r� r� r9 r9 r9 r: r� H s 349350351 352v 353>354+3551 r� c @ sF e Zd ZdZdWdXdd�ZdYd d �Zd
d� ZdZdd�Zd[dd�Zd\dd�Z d]d d �Z356d^d d!�Z dZd"d#�Z d_d'd(�Z
d`d)d*�Zdad-d.�Zdbd0d1�Zdcd2d3�Zddd4d5�Zdcd6d7�Zded8d9�Zdfd:d;�Zdfd<d=�Zdfd>d?�Zdfd@dA�ZdfdBdC�ZdfdDdE�ZdgdFdG�ZdcdHdI�Z dddJdK�Z dadLdM�Z dhdOdP�Z dfdQdR�Z dYdSdT�Z!dYdUdV�Z"dS )i�LLMProfileAnalyzerz8Advanced profile analyzer using fine-tuned financial LLMNr� �Optional[DeepVestConfig]c C s8 |pt � | _t�d�| _t| j�| _i | _| jj| _ d S )NzDeepVest.Analyzer)357r r� r3 r4 r[ r� �llm�analysis_cacher" �max_cache_sizer� r9 r9 r: r� � s358 zLLMProfileAnalyzer.__init__r� ry rV r c C s� t |�dd��t |�dd��t |�dd��d�|�dg ��t |�dd��t |�dd��t |�d d��g}t�d359�|��� ��� S ) z'Generate unique cache key for a profiler r� r rK �,r r r! r" r= )r r� r r@ r� rB rC )r8 r� Zkey_componentsr9 r9 r: r� � s � z!LLMProfileAnalyzer._get_cache_keyc C sf t | j�| jkr/t| j�� dd� d�}t| jd �}t|�D ]}|t |�k r.| j|| d = q dS dS )z,Manage cache size by removing oldest entriesc S r� r� r9 r� r9 r9 r: r� � r� z2LLMProfileAnalyzer._manage_cache.<locals>.<lambda>r� rL r N)r� r� r� r� r� r! r� )r8 r� Z
num_to_remover� r9 r9 r: r� � s � ��z LLMProfileAnalyzer._manage_cacher� c 360 � s( �zr| � |�}|| jv r!| jjr!| j�d|� �� | j| d W S | j�d|�dd�� �� | j�|�}| j� |�I dH }| �361||�}| � |�sS| j� d� | �
|�}| �||�}| jjrk|t�� d�| j|< | �� | j�d � |W S ty� } z| j�d362|� �� | �
|�W Y d}~S d}~ww ) z3Comprehensive profile analysis with recommendationsz"Using cached analysis for profile �resultz"Starting profile analysis for ID: r �unknownNz8Analysis results validation failed, using default values�r� ra z'Profile analysis completed successfullyzError in profile analysis: )r� r� r� r* r[ rw r� r� r� r� �_parse_response�_validate_resultsr� �_get_default_analysis�_enrich_analysisr r� r� rZ r\ )r8 r� r� r� r� �analysis_result�enriched_analysisr_ r9 r9 r: �analyze_profile� s4 �363 364 365 � ��z"LLMProfileAnalyzer.analyze_profile�profilesr� �List[ProfileAnalysisResult]c � s �z�g }g }g }t |�D ]'\}}� �|�}|� jv r)� jjr)|�� j| d � q |�|� |�|� q |s9|W S � fdd�|D �}� j�|�I dH } t t|| ��D ]p\}\}}366zD� � |367|�} � �368| �si� � |�} � � | |�} � jjr�� �|�}| t
�� d�� j|< || }
t|�|
kr�|�d� t|�|
ks�| ||
< W qR ty� } z� j�d|� d|� �� |�� � |�� W Y d}~qRd}~ww � jjrˈ �� t |�D ]\}}|du r�� � || �||< q�|W S t�y } z� j�d|� �� � fd d�|D �W Y d}~S d}~ww )369z"Analyze multiple profiles in batchr� c s g | ]}� j �|��qS r9 )r� r� �r r� r7 r9 r: r� ; r� z=LLMProfileAnalyzer.batch_analyze_profiles.<locals>.<listcomp>Nr� zError processing profile r� �!Error in batch profile analysis: c s g | ]}� � |��qS r9 )r� r� r7 r9 r: r� l r� )r� r� r� r� r* rX r� r� �zipr� r� r� r� r r� r� rZ r[ r\ r� )r8 r� �resultsZuncached_profilesZuncached_indicesr� r� r� r� r� r� r� r� Z insert_indexr_ r� r9 r7 r: �batch_analyze_profiles& s` �370371 372373 374 � 375 � ��� ��z)LLMProfileAnalyzer.batch_analyze_profilesr� �
original_datac 376 C s, zu|� d�}| �|�}| �|�}tdi d| �|��d| �|��d| �|��d| �|��d| �|��d| � |��d| �377|��d | � |��d378| � |��d | �
|��d | �|��d
| �|��d| �|��d| �|��d| �|��d|�d|��W S ty� } z| j�d|� �� | �|�W Y d}~S d}~ww )z'Parse LLM response into structured datar r� rK r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� zError parsing response: Nr9 )r� �_extract_asset_allocation� _extract_geographic_allocationr� �_extract_risk_score�_extract_horizon�_extract_goals�_extract_constraints�_extract_recommendations�_extract_explanation�_extract_risk_decomposition�_extract_goal_feasibility�_extract_investment_style�_extract_market_sensitivity�_extract_alerts�_extract_attention_points�_extract_market_context� _calculate_adaptability_score� _extract_stress_test_resultsrZ r[ r\ r� )r8 r� r �sectionsr� Zgeo_allocationr_ r9 r9 r: r� n sX 379380381382�383�384�385�386�387�388�389�390 �391 392�393 �394 �395
�396�397�����z"LLMProfileAnalyzer._parse_responser� r c 398 C s� zCd|j kr dksn tt|j d�d�|_ |jdkr d|_|js%W dS |js+W dS |j dkrA|jdk rA| j�d� |j� d� W dS t399y_ } z| j� d |� �� W Y d400}~dS d401}~ww ) z)Validate analysis results for consistencyr rW r% Fr� z4Inconsistency detected: high risk with short horizonuM Attention: profil à risque élevé avec horizon court, prudence recommandéeTz#Error validating analysis results: N) r� ri rh rK r� r� r[ r� r� rX rZ r\ )r8 r� r_ r9 r9 r: r� � s( 402 ���z$LLMProfileAnalyzer._validate_results�analysisc 403 C s� z�|j }g }|�dd�}tdd| d �d }|�|� |�dd�}|d d }|�|� |�d d�} |�d404d�}405| dkrN|406| } | d krGd nd} |�| � tt|�d
g ��d d�}
|�|
� |}|D ] }tdtd|| ��}qd||_ |j�||dt� v r�| nd|
d�� |j s�| �407|�|_ |j s�| � � |_ |j
s�|d d tdd|d �d |d tdd|d �d�|_
|js�|�d�r�|�d�}t|d�r�|�dd�}d|d }|j||d �|_|W S ty� } z| j�d |� �� |W Y d }~S d }~ww ) z,Enrich analysis with additional calculationsr r r �A rL r r' r� r r" r� 皙������r r� rW �financial_adjustment)Z408age_factorZknowledge_factorZfinancial_stability�goals_diversificationr� r� re r� �� market_beta�
interest_rate�economic_cycle� inflationr/ �calculate_goal_feasibilityr# � ��Q��?�{�G�z�?)r� r� zError enriching analysis: N)r� r� rh rX ri r� r� rQ �localsr� � _generate_default_allocationr� � _generate_default_geo_allocationr� r� r^ r rZ r[ r\ )r8 r r� Zbase_risk_scoreZ adjustmentsr Zage_adjustmentZ knowledgeZknowledge_adjustment�incomeZdebtrF r r Zfinal_risk_score�adjZ409objectivesr� r� r_ r9 r9 r: r� � sh 410 411 412413� 414415416�417418 ���z#LLMProfileAnalyzer._enrich_analysisc 419 C sH |� dd�d }t||� dd�|� ddg�i g d�d| �|�| �� d �S )420z(Generate default analysis when LLM failsr r' r% rK r u Épargne générale)u& Construire un portefeuille diversifiéu Maintenir une réserve d'urgence� Investir régulièrementu5 Analyse par défaut basée sur les données fournies.)r� rK r� r� r� r� r� r� )r� r� r# r$ )r8 r� r� r9 r9 r: r� � s 421 �z(LLMProfileAnalyzer._get_default_analysisr� rC rP c C s( |}d| d }d| d }|||d�S )z5Generate default asset allocation based on risk scorerW r� rL ��Actions� Obligations� Liquiditésr9 )r8 r� �stocks�bondsrT r9 r9 r: r#
s �z/LLMProfileAnalyzer._generate_default_allocationc C s ddddd�S )z&Generate default geographic allocationr� re rL r� )�Europe� Amérique du Nord�Asie-Pacifiqueu Marchés émergentsr9 r7 r9 r9 r: r$ s422 �z3LLMProfileAnalyzer._generate_default_geo_allocationr r� c C s` t dd� |D �d�}zt�d|�}|rt|d �nd}tt|d�d�W S ttfy/ Y dS w )z Extract risk score from textc s � � | ]423}|� d �r|V qdS )z1. Score de risqueN��424startswith�r �sr9 r9 r: r� & r� z9LLMProfileAnalyzer._extract_risk_score.<locals>.<genexpr>r� z (\d*\.?\d+)r rB rW )�nextr� �findallrC ri rh �425IndexErrorr� )r8 r Z risk_line�matchesr r9 r9 r: r $ s �z&LLMProfileAnalyzer._extract_risk_scorer! c C sR t dd� |D �d�}zt�d|�}|rt|d �W S dW S ttfy( Y dS w )zExtract investment horizonc s r1 )z4262. HorizonNr2 r4 r9 r9 r: r� 0 r� z6LLMProfileAnalyzer._extract_horizon.<locals>.<genexpr>r� z(\d+)r r% )r6 r� r7 r! r8 r� )r8 r Z horizon_liner9 r9 r9 r: r . s �z#LLMProfileAnalyzer._extract_horizonc C sb t dd� |D �d�}|sg S z|�d�d �� }t�d|�}dd� |D �W S ty0 g Y S w ) zExtract prioritized goalsc s r1 )z 3. ObjectifsNr2 r4 r9 r9 r: r� 9 r� z4LLMProfileAnalyzer._extract_goals.<locals>.<genexpr>r� �:r� � [•\-\d]+\.?\s*c S s g | ]427}|� � r|� � �qS r9 )r� )r �gr9 r9 r: r� @ r� z5LLMProfileAnalyzer._extract_goals.<locals>.<listcomp>)r6 r� r� r� rZ )r8 r �
goals_sectionZ428goals_textrz r9 r9 r: r 7 s �z!LLMProfileAnalyzer._extract_goalsc C s� t dd� |D �d�}|si S i }zT|�d�d �� }t�d|tj�r&d|d< t�d |tj�r2d|d429< t�d |tj�r>d|d < t�d
|tj�rJd|d< t�d|tj�rVd|d< t�d|tj�rbd|d< |W S tyo i Y S w )z#Extract constraints and limitationsc s r1 )z4. ContraintesNr2 r4 r9 r9 r: r� F r� z:LLMProfileAnalyzer._extract_constraints.<locals>.<genexpr>r� r: r� u liquidité|liquide|court termeT�liquidity_neededu esg|durable|responsable|éthiqueZ esg_focuszrevenu|dividende|rente� income_focuszprotection|capital|garantiZcapital_protectionu fiscalité|impôt|tax�tax_optimizationu! succession|transmission|héritageZinheritance_planning)r6 r� r� r� r� �IrZ )r8 r Zconstraints_sectionr� �textr9 r9 r: r D s, �z'LLMProfileAnalyzer._extract_constraintsc C s� g }t dd� |D �d�}|r)t�d|�}|D ]}|�� }|r(|�d�s(|�|� q|sRt dd� |D �d�}|rRt�d|�}|D ]}|�� }|rQ|�d�sQ|�|� q?|sXg d�}|S ) z Extract specific recommendationsc s r1 )�8. RecommandationsNr2 r4 r9 r9 r: r� h r� z>LLMProfileAnalyzer._extract_recommendations.<locals>.<genexpr>r� r; rC c s r1 )z7. Plan d'actionNr2 r4 r9 r9 r: r� s r� z7. Plan��5Diversifier le portefeuille selon le profil de risque�$ Maintenir une épargne de sécuritéu1 Adopter une stratégie d'investissement régulier)r6 r� r� r� r3 rX )r8 r r� Z rec_section�parts�partZ430clean_partZ plan_sectionr9 r9 r: r e s* 431� 432�z+LLMProfileAnalyzer._extract_recommendationsc sz t dd� |D �d�}|r|�dd�d �� }|r|S g }dD ]� t � fdd�|D �d�}|r3|�|� q |r;d �|�S d433S ) z Extract detailed explanationc s r1 )z9. ExplicationNr2 r4 r9 r9 r: r� � r� z:LLMProfileAnalyzer._extract_explanation.<locals>.<genexpr>r� r: rW r� )rW r� r' r+ � c 3 s$ � | ]
}|� � � d ��r|V qdS )�.Nr2 r4 �Z section_numr9 r: r� � � �" z434 435u3 Analyse basée sur le profil d'investisseur fourni.)r6 r� r� rX r )r8 r Zexplanation_sectionr� Zcombined_explanation�sectionr9 rK r: r436 � s 437�438z'LLMProfileAnalyzer._extract_explanationc �439 t dd� |D �d�}i }|r1t�d|�}|D ]}|�d��� }t|�d��dd��}|d ||< q|sc|D ]-}t�d440|tj�rbt�d|�}|D ]}|�d��� }t|�d��dd��}|d ||< qGq5t |�441� �� d � k rsd k sxn � d
kr�� fdd�|� � D �}|S )z(Extract asset allocation recommendationsc s � � | ] }d |� � v r|V qdS )zclasse d'actifsN��lowerr4 r9 r9 r: r� � r� z?LLMProfileAnalyzer._extract_asset_allocation.<locals>.<genexpr>r� �/ ([A-Za-zÀ-ÖØ-öø-ÿ\s]+)[\s:]+([\d.,]+)\s*%rW r� r� rJ r u$ allocation|répartition|portefeuiller �G�z��?�)\���(�?c � i | ] \}}||� �qS r9 r9 r� ��totalr9 r: r` � � z@LLMProfileAnalyzer._extract_asset_allocation.<locals>.<dictcomp>� r6 r� �finditerr� r� rC �replacer� rA ra rb r� ) r8 r Zallocation_section�442allocationr9 �matchrH �443percentagerM r9 rV r: r � �* � z,LLMProfileAnalyzer._extract_asset_allocationc rN )z-Extract geographic allocation recommendationsc s rO )u
géographiqueNrP r4 r9 r9 r: r� � r� zDLLMProfileAnalyzer._extract_geographic_allocation.<locals>.<genexpr>r� rR rW r� r� rJ r u zone|région|international|paysr rS rT c rU r9 r9 r� rV r9 r: r` � rX zELLMProfileAnalyzer._extract_geographic_allocation.<locals>.<dictcomp>rY ) r8 r Z geo_sectionr\ r9 r] �regionr^ rM r9 rV r: r � r_ z1LLMProfileAnalyzer._extract_geographic_allocationc C sb t dd� |D �d�}i }|r�z�t�d|�}|r2t|�d��dkr)t|�d��d nt|�d��|d< t�d|�}|rUt|�d��dkrLt|�d��d nt|�d��|d < t�d444|�}|rxt|�d��dkrot|�d��d nt|�d��|d < t�d |�}|r�t|�d��dkr�t|�d��d nt|�d��|d
< W n ty� Y nw |s�ddddd�}|S )zExtract risk decompositionc s � � | ] }d |v r|V qdS )zAnalyse des risquesNr9 r4 r9 r9 r: r� � � � zALLMProfileAnalyzer._extract_risk_decomposition.<locals>.<genexpr>r� u marché[^\d]*(\d+(?:\.\d+)?)rW r � market_risku crédit[^\d]*(\d+(?:\.\d+)?)� credit_risku liquidité[^\d]*(\d+(?:\.\d+)?)�liquidity_risku" opérationnel[^\d]*(\d+(?:\.\d+)?)�operational_riskr� rL )rc rd re rf )r6 r� r� rC r� r� )r8 r Z risk_sectionr rc rd re rf r9 r9 r: r � s6 6 6 6 6� ��z.LLMProfileAnalyzer._extract_risk_decompositionc C sv t dd� |D �d�}i }|r9t�d|�}|D ]"}|�d��� }t|�d��}tt|dkr0|d n|d�d�||< q|S ) z#Extract goal feasibility assessmentc s ra )zObjectifs prioritairesNr9 r4 r9 r9 r: r� � rb z?LLMProfileAnalyzer._extract_goal_feasibility.<locals>.<genexpr>r� z([^:]+):\s*(\d+(?:\.\d+)?)rW r� r r )r6 r� rZ r� r� rC ri rh )r8 r r= r� Z goal_matchesr] r� r r9 r9 r: r � s &z,LLMProfileAnalyzer._extract_goal_feasibilityc s� dddddd�}t dd� |D �d�}|rott�d|tj��d |d< tt�d |tj��d |d445< tt�d |tj��d |d < tt�d
|tj��d |d< tt�d|tj��d |d< t|�� �� � dkro� fdd�|�� D �}|S )z&Determine recommended investment stylerE )r� �growthr% �momentum�qualityc s ra )ZRecommandationsNr9 r4 r9 r9 r: r� rb z?LLMProfileAnalyzer._extract_investment_style.<locals>.<genexpr>r� u valeur|sous-évalué|valuerL r� z croissance|growth|innovationrg zrevenu|dividende|incomer% zmomentum|tendance|trendrh u qualité|quality|solideri r c rU r9 r9 r� rV r9 r: r` rX z@LLMProfileAnalyzer._extract_investment_style.<locals>.<dictcomp>)r6 r� r� r7 rA ra rb r� )r8 r Z
style_weightsr� r9 rV r: r
s" � z,LLMProfileAnalyzer._extract_investment_stylec s� ddddd�}d� |�}d|�� v r%t�d|tj�}|r%t|�d��|d< d|�� v r9tt�d |tj��d446 |d < d |�� v rMtt�d
|tj��d447 |d< d|�� v ratt�d|tj��d448 |d< t |�449� �� � dkrv� fdd�|� � D �}|S )z(Analyze sensitivity to market conditionsrE r r �betazbeta[^\d]*(\d+(?:\.\d+)?)rW r Ztauxz taux|rater� r �cycleu cycle|économiquer r zinflation|prixr c rU r9 r9 r� �� max_valuer9 r: r` < rX zBLLMProfileAnalyzer._extract_market_sensitivity.<locals>.<dictcomp>) r rQ r� r� rA rC r� r� r7 rh rb r� )r8 r r� Z
analysis_textZ450beta_matchr9 rl r: r s( �451 z.LLMProfileAnalyzer._extract_market_sensitivityc C st g }t dd� |D �d�}|r8g d�}|D ]#\}}t�||tj�}|D ]}|�||�d��� t�� � � d�� q"q|S )z,Extract alerts and critical attention pointsc s ra )�Points de vigilanceNr9 r4 r9 r9 r: r� C rb z5LLMProfileAnalyzer._extract_alerts.<locals>.<genexpr>r� ))z(!+|ATTENTION|ALERTE)[^\n]*r� )zattention|vigilance[^\n]*r� )znoter|remarquer[^\n]*rw r )r� rJ ra )452r6 r� rZ rA rX r� r� r r� r? ) r8 r r� �attention_sectionZalert_patterns�patternr� r9 r] r9 r9 r: r @ s 453454��z"LLMProfileAnalyzer._extract_alertsc C s: g }t dd� |D �d�}|rt�d|�}dd� |D �}|S )z!Extract specific attention pointsc s �$ � | ]
}d |v s d|v r|V qdS )zPoints d'attentionrn Nr9 r4 r9 r9 r: r� Z rL z?LLMProfileAnalyzer._extract_attention_points.<locals>.<genexpr>r� r; c S s& g | ]}|� � r|�d �s|� � �qS )ZPoints)r� r3 �r �pr9 r9 r: r� ^ s & z@LLMProfileAnalyzer._extract_attention_points.<locals>.<listcomp>)r6 r� r� )r8 r r� ro �pointsr9 r9 r: r W s z,LLMProfileAnalyzer._extract_attention_pointsc C s� i }t dd� |D �d�}|rQt�d|tj�rd|d< nt�d|tj�r(d|d< nd |d< t�d455|tj�r9d |d < nt�d
|tj�rFd|d < nd|d < | �|�|d< |S )z Extract relevant market contextc s rq )u Contexte de marchéu conditions de marchéNr9 r4 r9 r9 r: r� e rL z=LLMProfileAnalyzer._extract_market_context.<locals>.<genexpr>r� u baiss|bear|négatifZbearZ
market_regimezhauss|bull|positif�bull�neutralzvolatile|instable�high�456volatilityz stable|calme�lowZmoderate� sentiment)r6 r� r� rA �_analyze_market_sentiment)r8 r �contextZmarket_sectionr9 r9 r: r b s 457458459460z*LLMProfileAnalyzer._extract_market_contextc C sX d}d� |�}g d�}g d�}|| D ]\}}t�||tj�r)tt|| d�d�}q|S )z$Calculate profile adaptability scorerB r ))zflex|adapt|ajustr� )u divers|équilibrr� )zlong terme|patientr� )u expérience|connaissancer� )u stable|régulierr� ))zrigid|fix|strictr )zrisqu|peur|craintr )zcourt terme|urgentr )u limité|contraintr )u instable|irrégulierr r rW )r r� r� rA ri rh )r8 r r rB Zpositive_factorsZnegative_factorsrp r r9 r9 r: r | s 461 �z0LLMProfileAnalyzer._calculate_adaptability_scorerB c C sD t t�d|tj��}t t�d|tj��}||krdS ||kr dS dS )zAnalyze market sentimentz"positif|optimiste|favorable|hausseu' négatif|pessimiste|défavorable|baisse�positive�negativerv )r� r� r7 rA )r8 rB Zpositive_countZnegative_countr9 r9 r: r{ � s z,LLMProfileAnalyzer._analyze_market_sentimentc 462 C s� i }t dd� |D �d�}|rAt�d|�}|D ]*}|�d��� }ztt�d|�d���d��}|d ||< W q ttfy@ Y qw |sJd d463d d d
�}|S )zExtract stress test resultsc s ra )z Stress testsNr9 r4 r9 r9 r: r� � rb zBLLMProfileAnalyzer._extract_stress_test_results.<locals>.<genexpr>r� z([^:]+):\s*-?\d+(?:\.\d+)?%rW z-?\d+(?:\.\d+)?r r g333333ӿ�333333ÿg������ɿr )Z market_crashZinterest_rate_shockZcurrency_crisisZinflation_shock) r6 r� rZ r� r� rC r� r� �AttributeError)r8 r r Zstress_section� scenariosZscenario�name�impactr9 r9 r: r � s& ��z/LLMProfileAnalyzer._extract_stress_test_resultsc 464 � sx �z| j �|�}| j �|�I dH }|�dd��� }|W S ty; } z| j�d|� �� | �|�W Y d}~S d}~ww )z%Generate detailed profile descriptionNr� r� z&Error generating profile description: ) r� r� r� r[ r� rZ r[ r\ � _generate_default_description)r8 r� r� � descriptionr_ r9 r9 r: � generate_profile_description� s � ��z/LLMProfileAnalyzer.generate_profile_descriptionc C s� |� dd�}|� dd�}d�|� ddg��}|� dd�}|� d d465�}|d kr(d n|dkr.d
nd}d|� d|� d|� d|� d|� d|� d|� d�S )z0Generate default description if generation failsr r� r r� r u épargne généraler r' rK r% r� Zprudentu modéréZ dynamiquezProfil investisseur de z ans avec un revenu annuel de u3 €. 466Ce profil présente une tolérance au risque z (niveau z&/5) et un horizon d'investissement de z% ans.467Ses principaux objectifs sont: uc .468 469Une stratégie d'investissement diversifiée est recommandée, adaptée à son niveau de risque u{ . 470L'allocation d'actifs devra tenir compte de ses objectifs spécifiques tout en respectant son horizon d'investissement.471r� )r8 r� r r% rz Zriskr
r r9 r9 r: r� � s" �����z0LLMProfileAnalyzer._generate_default_descriptionrV �r� r� r� )r� ry rV r� )r� r� rV r� )r� r r ry rV r� )r� r� rV r )r r� r� ry rV r� )r� rC rV rP r )r r� rV rC )r r� rV r! )r r� rV r� )r r� rV ry )r r� rV r )r r� rV rP )r r� rV r� )rB r rV r )#r< r= r> r? r� r� r� r� r r� r� r� r� r# r$ r r r r r r472 r r r r r
r r r r r r{ r r� r� r9 r9 r9 r: r� � sB 473
474475+476H477!478 479O480481
482 483 484 485 486 487
488!489 490491 492 493$494495496!497498 499500 501 502r� c @ s> e Zd ZdZdddedd�Zdd� Zdfd
d�Zdgdd�Zdhdd�Zdidd�Z djd d �Z503dkd d �Z dld"d#�Z dmd$d%�Z
dddnd)d*�Zdod,d-�Zd.d/� Zdpd2d3�Zdqd7d8�Zdqd9d:�Zdrd<d=�Zdsd?d@�ZdtdudFdG�ZdvdHdI�ZdwdLdM�ZdwdNdO�ZdxdQdR�ZdvdSdT�ZdydWdX�Z dzdZd[�Z dvd\d]�Z d{d^d_�Z d|d`da�Z dvdbdc�Z!dS )}�DeepVestProfilerz9Advanced investor profiler with fine-tuned AI integrationNr� r� c C sB |pt � | _t�d�| _t| j�| _i | _| jjr | � � dS dS )z&Initialize profiler with configurationzDeepVest.ProfilerN)504r r� r3 r4 r[ r� � llm_analyzerr� r$ �_ensure_db_directoryr� r9 r9 r: r� � s �zDeepVestProfiler.__init__c C s< t j�| jj�s t �| jj� | j�d| jj� �� dS dS )z Ensure database directory existsz Created database directory: N)rp rr r� r� r# rq r[ rw r7 r9 r9 r: r� � s �z%DeepVestProfiler._ensure_db_directoryr� ry rV r c � s( �z�| j �d� |�� }d|v r|�d�|d< n d|v r#|�d�|d< | j�|�I dH }| j�|�I dH }td'i d|�d��d|�dd��d |�d d505��d |�d d��d |�d d��d
|�d
g ��d|�dd��d|�di ��d|�dd��d|�dd��d|�dd��d|�dd��d|�dd��d|�dd��d|�dd��d|�dd��d|�dd ��d |�d |�d d���d |�d |j �d!|j506�d"|�d"d#��d$|��}| � ||�I dH |� � |�
� || j|j< | jjr�| �|� | j �d%|j� �� |W S t�y } z507| j �d&|� �� � d}~ww )(z2Create complete investor profile with LLM analysisz Creating new investor profile� épargne_mensueller# � épargne mensuelleNr r r' rK r% rD r r r Fr� r r r r r! r" r$ r� r% r& r( r' r) rp r9 r� r� r: rB r0 z&Profile created successfully with ID: zError creating profile: r9 )r[ rw �copy�popr� r� r� r r� r� r� �_add_detailed_analysisr< rR r� r r� r$ �_save_profile_to_dbrZ r\ )r8 r� �processed_datar| r0 r� r_ r9 r9 r: �create_profile� s� � 508� � � � � � 509� � � � � � � � � � ���� � � �" 510��z DeepVestProfiler.create_profiler� r� c � s& �zTt |�dd�d |jdkr|j|j nd|�dd�dkr,|�dd�|�dd� d nd|�d d�|jr9|jjnd511|j|�d d �|�d
i �|�di �|�di �d�512|_W n typ } z| j �513d|� �� W Y d}~nd}~ww z<t d|�d�dv r}dnd |�dd� |�dd�| � |j
�|�dg �|�dd�|�di �|�di �|�di �d�|_W n ty� } z| j �514d |� �� W Y d}~nd}~ww z,td d � t|j�D �|�d i �|�d i �|j|�d!i �|�d"i �|�d#i �d$�|_W dS t�y } z| j �515d%|� �� W Y d}~dS d}~ww )&z Add detailed analyses to profilerD r' r% r r r# rW r� rI rB rM rL rQ rR rS )516rD rF rG rI rJ rK rM rQ rR rS z,Error creating detailed financial analysis: Nr( )�marriedZ partneredrp rt ru rv rw rx )ro rp rr rt ru rv rw rx z)Error creating detailed family analysis: c S s g | ] \}}||d d��qS )rW )r� �priorityr9 )r r� r� r9 r9 r: r� i r� z;DeepVestProfiler._add_detailed_analysis.<locals>.<listcomp>Zgoal_timeframesr� Z goal_amountsr� Z risk_by_goal)r� r� r� r� r� r� r� z/Error creating detailed investment objectives: )rA r� r r" r9 r� rK r- rZ r[ r� rn �_determine_life_stager r. r� r� r r/ )r8 r� r� r_ r9 r9 r: r� D s^ �.517518519520521 � ��$522523524525526527528 �529 ��530531532533534� ��z'DeepVestProfiler._add_detailed_analysisr r! r c C s@ |dk rdS |dk r dS |dk rdS |dk rdS |d k r d535S d S ) z!Determine life stage based on age� Z early_career�# Zcareer_building�- Zfamily_building�7 Z peak_earningr Zpre_retirementZ536retirementr9 )r8 r r9 r9 r: r� t s z&DeepVestProfiler._determine_life_stagec 537 C s~ z"|j � d�}tj�| jj|�}|j|dd� | j�d|� �� W dS t y> } z| j�538d|� �� W Y d}~dS d}~ww )z"Save profile to persistent storage�.jsonT)rh zProfile saved to database: z"Error saving profile to database: N) r rp rr r r� r# ry r[ rw rZ r\ )r8 r� �filenamerg r_ r9 r9 r: r� � s ��z$DeepVestProfiler._save_profile_to_db�539profile_id�Optional[PersonalProfile]c 540 � s� �zO|| j v r| j�d|� d�� | j | W S | jjrDtj�| jj|� d��}tj� |�rD| j�541d|� d�� t � |�}|| j |< |W S | j�
d|� d�� W dS tyo } z| j�d|� d |� �� W Y d}~dS d}~ww )542u Récupérer un profil par son ID�Profile z found in memory cacher� zLoading profile z from disk storage�543 not foundNzError retrieving profile r� )r� r[ r� r� r$ rp rr r r# r� rw r r� r� rZ r\ )r8 r� rg r� r_ r9 r9 r: � get_profile� s& �544 545546��z DeepVestProfiler.get_profilerY c 547 � sv �z�| � |�I dH }|std|� d���|�� }d|v r$|�d�|d< n d|v r/|�d�|d< ddlm} ||�}d g}|D ] }||v rG||= q>|�� D ] \} }548| |v rX|549|| < qLdd550lm} | t �j551� � fd d �|�� D �} t di | ��}
t |
d
�r|
� � | j
�|
�I dH }||
_| �|
�I dH | j�d|� d�� |
W S ty� } z| j�d|� dt|�� �� � d}~ww )u= Met à jour un profil existant avec de nouvelles informationsNzProfile with ID r� r� r# r� r )r r{ )� signaturec s i | ] \}}|� v r||�qS r9 r9 r� �Zprofile_paramsr9 r: r` � r� z3DeepVestProfiler.update_profile.<locals>.<dictcomp>r< r� z updated successfullyzError updating profile r� r9 )r� r� r� r� � dataclassesr r� �inspectr� r �552parametersr^ r< �analyzerr� r9 Z
_save_profiler[ rw rZ r\ r )r8 r� rY r� Zprocessed_updatesr Z profile_dictZfields_to_remover r� r� r� Z
filtered_dictr] r� r_ r9 r� r: �update_profile� sJ � �� 553554 ��z DeepVestProfiler.update_profiler c s h d�}t � fdd�|D ��S )z0Determine if profile changes require re-analysis>555 r" r r r rK r r r( r) r! c 3 s � | ]}|� v V qd S rV r9 )r r �rY r9 r: r� � r� z<DeepVestProfiler._are_changes_significant.<locals>.<genexpr>)r� )r8 rY Zsignificant_fieldsr9 r� r: �_are_changes_significant� s z)DeepVestProfiler._are_changes_significantc 556 � s� �z1|| j v r | j |= | jjr&tj�| jj|� d��}tj�|�r&t�|� | j �557d|� d�� W dS t yQ } z| j � d|� d|� �� W Y d}~dS d}~ww ) zSupprimer un profilr� r� z deleted successfullyTzError deleting profile r� NF)
r� r� r$ rp rr r r# r� �remover[ rw rZ r\ )r8 r� rg r_ r9 r9 r: �delete_profile� s �558 559��z DeepVestProfiler.delete_profile�filter_criteria�Optional[Dict[str, Any]]r� c 560 � s� �z:g }| j jr | �� | j�� D ]'\}}|r | �||�s q|j|j|j|j |j561� � |j � � |j
d�}|�|� q|W S tyX } z| j�d|� �� g W Y d}~S d}~ww )uH Liste tous les profils disponibles avec critères de filtrage optionnels)r r r� rK Z
creation_dater rz zError listing profiles: N)r� r$ � _load_all_profiles_to_memoryr� r� �_profile_matches_criteriar r r� rK r r? r r rX rZ r[ r\ )r8 r� Z
profiles_listr� r� Z profile_infor_ r9 r9 r: �
list_profiles s. �� ��z DeepVestProfiler.list_profiles�criteriac C s� |� � D ]M\}}t||�s dS t||�}t|t�r=d|v s"d|v r=d|v r/||d k r/ dS d|v r<||d kr< dS qt|t�rJ||vrI dS q||krQ dS qdS )u8 Vérifie si un profil correspond aux critères de filtreFri rh T)r� r^ r_ r� rm r� )r8 r� r� r r� Z
profile_valuer9 r9 r: r� s$ 562563�564��z*DeepVestProfiler._profile_matches_criteriac C s* | j jsdS zr| j j}tj�|�s | j�d|� d�� W dS dd� t�|�D �}| j� dt565|�� d�� |D ]?}|� dd �}|| j vrutj�
||�}z t�|�}|| j |< W q6 tyt } z| j�d566|� d |� �� W Y d}~q6d}~ww q6W dS ty� } z| j�d |� �� W Y d}~dS d}~ww )
uF Charge tous les profils depuis le stockage persistant vers la mémoireNzDatabase directory r� c S s g | ] }|� d �r|�qS )r� )�endswith)r rx r9 r9 r: r� D rX zADeepVestProfiler._load_all_profiles_to_memory.<locals>.<listcomp>zFound z profile files in databaser� r� r~ r� z"Error loading profiles from disk: )r� r$ r# rp rr r� r[ r� �listdirrw r� r[ r� r r r� rZ r\ )r8 r# Z567json_filesZ json_filer� rg r� r_ r9 r9 r: r� 8 s4 568569$����570 ��z-DeepVestProfiler._load_all_profiles_to_memory� profile_idsr� c 571 � s� �zQg }i }|D ]}| � |�I dH }|r |�|� |||< q|s)| j�d� i W S | �|�}| �|�}| �|�}i } t|�dkrH| �|�I dH } |||| t|�d�W S t ys }572 z| j�573d|574� �� dt |575�iW Y d}576~577S d}578~579ww )uB Analyse par lots de plusieurs profils pour détection de tendancesNz*No valid profiles found for batch analysisr% )�580age_groups�risk_distribution� goal_trendsZprofile_clustersZtotal_profiles_analyzedr� r\ ) r� rX r[ r� �_group_profiles_by_age�_group_profiles_by_risk�_analyze_goal_trendsr� �_cluster_profilesrZ r\ r ) r8 r� r� Z profile_mapr� r� r� � risk_groupsr� �clustersr_ r9 r9 r: r U s< �581� 582583584 ���z'DeepVestProfiler.batch_analyze_profilesr� �List[PersonalProfile]r� c C s� ddddddd�}|D ]N}|j }|dkr |d d7 < q |dkr*|d d7 < q |dkr7|d d7 < q |d585krD|d d7 < q |d krQ|d
d7 < q |d d7 < q |S )u% Groupe les profils par tranche d'âger )�18-25�26-35�36-45�46-55�56-65�65+r� r� rW r� r� r� r� r� r� r r� r� )r )r8 r� r� r� r r9 r9 r: r� | s* � z'DeepVestProfiler._group_profiles_by_agec C s� dddddd�}|D ]A}|j }|dk r |d d7 < q586|dk r)|d d7 < q587|dk r6|d d7 < q588|d589k rC|d d7 < q590|d d7 < q591|S )
z'Groupe les profils par niveau de risquer )r� r� r� r� r� rL r� rW r� r� r� r� r� r� r� r� )r8 r� r� r� r� r9 r9 r: r� � s$ �z(DeepVestProfiler._group_profiles_by_risk�Dict[str, Dict[str, Any]]c C s� i }|D ]?}|j D ]9}||vrdddg d�||< || d d7 < || d |j7 < || d |j7 < || d �|j� q q|�� D ]&\}}|d }|dkrn|d | < |d | < |t|� d |d < qH|S )592z9Analyse les tendances dans les objectifs d'investissementr )�count�avg_risk_score�avg_investment_horizonr� r� rW r� r� r� r r^ )r r� rK rX r r� r� )r8 r� Z all_goalsr� r� r� r� r9 r9 r: r� � s, 593594���z%DeepVestProfiler._analyze_goal_trends�Dict[str, List[str]]c 595 � s� �z�g }g }|D ]=}|j |jd |jd |jd |jd |jdkr&|jd nd|jdkr1|jd ndt|j�d g}|� |� |� |j596� qt|�dk rQd|iW S ddl m } dd l
m} |� }|�|�} ttd597t|�d �d�}598||599d dd �} | �| �} i }
t| �D ] \}}d
|d � �}||
vr�g |
|< |
| � || � q�|
W S ty� } z| j�d|� �� ddd� |D �iW Y d}~S d}~ww )uC Regroupe les profils en clusters basés sur leurs caractéristiques�600 r r% r i@B r' Z cluster_1)�KMeans)�StandardScalerr� �* )�601n_clusters� random_state�n_initZcluster_rW z Error in profile clustering: Z
cluster_errorc S s g | ]}|j �qS r9 )r rr r9 r9 r: r� 602 s z6DeepVestProfiler._cluster_profiles.<locals>.<listcomp>N)r� rK r r rD r! r" r� r rX r Zsklearn.clusterr� Zsklearn.preprocessingr� �
fit_transformri rh � fit_predictr� rZ r[ r\ )r8 r� �featuresr� r� Zfeature_vectorr� r� �scalerZfeatures_scaledr� �kmeansr� Z cluster_dictr� Z603cluster_idZ cluster_namer_ r9 r9 r: r� � sJ � �604 605 606607 ��z"DeepVestProfiler._cluster_profilesFr� rC rK r c 608 s z�|}|dkr |d }d}|dk rd}n|dk rd}n|dk r"d }n |d609k r)d }nd }i }|dkr8d
ddd�}n'|dkrCddd
d�}n |d krNdddd�}n|d krYdddd�}ndddd�}d}|dk rhd}n|dkrnd}|dkr�t |d t|��|dkr�dnd }|d |7 < | } | d }610| d } |d |6117 < |d | 7 < |r�t |d d�} |d | 8 < | |d < d!d"� |�� D �}t|�� �� � fd#d"�|�� D �}|||d$�d%�W S t�y }
z | j�d&t|
�� �� dddd�dd d$�d%�W Y d'}
~
S d'}
~
ww )(u� Génère une allocation d'actifs basée sur le profil de risque et l'horizon612 613 Args:614 risk_score: Score de risque (1-5 ou 0-1)615 investment_horizon: Horizon d'investissement en années616 esg_preferences: Indique si l'investisseur a des préférences ESG617 618 Returns:619 Dictionnaire contenant l'allocation d'actifs et le profil de risque620 rW g @r� rL r� r� r� r� r� r� r� r� �333333�?g�������?r( re g�������?rB r� r� rf r� g333333�?r r% r � r) r� r* r+ � Actions ESGc S s i | ]621\}}|t d |��qS )r )rh r� r9 r9 r: r` e622 r� z>DeepVestProfiler.generate_asset_allocation.<locals>.<dictcomp>c rU r9 r9 r� rV r9 r: r` i623 rX �r r )r� r z#Error generating asset allocation: N) ri �absr� ra rb rZ r[ r\ r )r8 r� rK r Znormalized_riskr r\ Zhorizon_factorZ action_shiftZremaining_shiftZobligation_shiftZliquidity_shiftZesg_allocationr_ r9 rV r: �generate_asset_allocation624 s� �����" ��625���z*DeepVestProfiler.generate_asset_allocationc 626 � s$ �z�|r|j s td��t|dd�}|dkr$t|d�r$t|jd�r$|jj}d|j kr/dkr4n n|jnd}| j||j|j d�}g }|�627d � |j d628k rW|�629d � |�630d � n|j d
k rg|�631d� |�632d� n633|�634d� |�635d� d|j v r{|�636d� d|j v r�|�637d� d|j v r�|�638d� |j
|jkr�|�639d� ||jd d k r�|�640d� t|�dkr�|d d� }|j t�� �� |d |d |t|jd d |�|jd d!�| �||�d"�}| j�d#|j � �� |W S t�y } z | j�d$t|�� �� d%d&id'd(dd)�g d*�d+�W Y d }~S d }~ww ),uF Génère une stratégie d'investissement personnalisée pour un profilzInvalid profiler# r r- rW r% r' )r� rK r rE r u@ Privilégier les investissements à fort potentiel de croissanceu7 Adopter une stratégie d'investissement régulier (DCA)rE u: Équilibrer croissance et sécurité dans votre allocationu. Réviser annuellement votre stratégie fiscaleu( Sécuriser progressivement votre capitalu0 Optimiser votre stratégie en vue de la retraite�Retraitez3Maximiser les versements sur votre plan de retraitezAchat immobilierz1Constituer un apport pour votre projet immobilieru Études des enfantsu= Mettre en place une épargne dédiée aux études des enfantsu5 Prioriser le remboursement des dettes à taux élevér� r� u' Augmenter votre taux d'épargne mensuelNr r� r� rg )r# Zemergency_fund)r� ra r r� r� �targetsZinvestment_productsz*Generated investment strategy for profile z&Error generating investment strategy: r r� r� re r( rD )r r� r� )r r� r_ r^ r- r# r r� rK r rX r r r" r r� r r� r? rh Z_recommend_productsr[ rw rZ r\ r )r8 r� r# r� r� r� �strategyr_ r9 r9 r: � generate_investment_strategy|641 sn �642 $�643644645 646647 648649650651652653654655 656657 658�659�
660���z-DeepVestProfiler.generate_investment_strategyr\ rP c s |� � }|jr!d|v r!|�dd�}|dkr!|d |d< |d |d< t|d�rl|jrl|jj}|dkrld|v rltd|�}|d |k rl||d }t|�� �D ]\}} |dkrg| |d |d }661td| |662 �||< qL||d< t |�663� �� t � d664 �d kr�� fd d
�|�� D �}|S )uI Raffine l'allocation d'actifs basée sur des contraintes supplémentairesr) r re r� r� r- r+ r� rW r� rS c rU r9 r9 r� rV r9 r: r` �665 rX z=DeepVestProfiler._refine_asset_allocation.<locals>.<dictcomp>) r� r r� r^ r- rM rh r� r� ra rb r� ) r8 r\ r� �refinedZregular_stocksrM Zmin_cashZ shortfallr� r � reductionr9 rV r: �_refine_asset_allocation�666 s, 667 � z)DeepVestProfiler._refine_asset_allocationc s |s ddddd�}|� � }|jdk r4d|v r3|d }|d |d< dD ]}||v r2|| |d 7 < q"n3|jd668krgd|v rg|d dk rgtdd|d �}|d |7 < dD ]}||v rf|| |d 8 < qVt|�� �� t� d �d
kr�� fdd�|�� D �}|S )uN Raffine l'allocation géographique basée sur des contraintes supplémentairesr� re rL r� �r. r/ r0 � Pays émergentsr� rB )r. r/ rf r� r� r� rS c rU r9 r9 r� rV r9 r: r` rX zBDeepVestProfiler._refine_geographic_allocation.<locals>.<dictcomp>)r� r� ri ra rb r� r� )r8 r\ r� r� Zemergingr` �increaser9 rV r: � _refine_geographic_allocation�669 s6 �670 �671� z.DeepVestProfiler._refine_geographic_allocationr� c C s� g }|� dddg d�d�� |�di �}g }|�� D ]\}}|� d|d�d |� d672�� q|� d d d
|d�� |� dddg d�d�� |� dddg d�d�� |S )uC Génère des étapes d'implémentation pratiques pour la stratégierW zMise en place des comptesu? Ouvrir les comptes nécessaires pour implémenter la stratégie)uE Ouvrir un compte-titres classique pour les investissements générauxu4 Mettre en place un PEA pour les actions européennesuD Considérer une assurance-vie pour les investissements à long terme)�order�titler� �actionsr� zAllouer r� u( du portefeuille à la classe d'actifs "�"r� z Allocation initiale des actifsuF Répartir les investissements selon l'allocation d'actifs recommandéer' u Calendrier d'implémentationuI Établir un calendrier progressif pour l'implémentation de la stratégie)zEMois 1: Mise en place des comptes et investissement de 25% du capitalu0 Mois 2-3: Investissement de 25% supplémentairesz+Mois 4-6: Investissement du capital restantuE Trimestriel: Rééquilibrage du portefeuille selon l'allocation cibler+ zSuivi et ajustementsu9 Établir un processus de suivi régulier de la stratégie)z3Suivre mensuellement la performance du portefeuilleu@ Vérifier trimestriellement l'alignement avec l'allocation cibleu0 Réévaluer annuellement la stratégie complètez<Ajuster en fonction des changements de situation personnelle)rX r� r� )r8 r� �stepsr� Zallocation_actionsr� r r9 r9 r: � _generate_implementation_steps s< � ��
� z/DeepVestProfiler._generate_implementation_stepsc C sn |j dks673|jdkrd}d}n|j dk s|jdkr d}d}nd }d674}|||jd kr+d nd
t�� | �|� d�S )u3 Détermine le calendrier de rééquilibrage optimalr� r+ �
Trimestrieller� re r� �Annueller� � Semestrielleg333333�?r' zThreshold-basedzCalendar-based)� frequencyZdrift_threshold�methodZnext_scheduled)r� r r r� �_frequency_to_timedelta)r8 r� r� � thresholdr9 r9 r: � _determine_rebalancing_scheduleU s �z0DeepVestProfiler._determine_rebalancing_scheduler� r c C sR |dkr t dd�S |dkrt dd�S |dkrt dd�S |dkr$t d d�S t dd�S )675u5 Convertit une fréquence textuelle en objet timedeltaZ Mensueller r� r� r� r� � r� im )r )r8 r� r9 r9 r: r� i s 676677678679680z(DeepVestProfiler._frequency_to_timedelta�yearsc 681 C s� ddd�ddd�ddd�ddd�d d d�d682d d�d683d d�dd
d�d�}d}d}|� � D ] \}}||v rG||| d | 7 }||| d | 7 }q+|dkrQ|d9 }n|dk rY|d9 }d| | d }||||d ||d d�||d�d�S ) uH Calcule les performances attendues basées sur l'allocation et l'horizong�Q� ��?g684ףp=685�?)rV rx g�p=686ף�?g��(\���?r r� r� rS r! g{�G�z�?rL r� )r) r� r* Z687Immobilierr+ �Oru Matières premièresZCryptomonnaiesr rV rx r� g�������?r% gffffff�?rW r� g�������?)� conservative�expectedZ688optimistic)Z time_horizonZasset_assumptions)Zexpected_annual_return�expected_volatilityZexpected_total_returnr� � assumptions)r� ) r8 r\ r� r� r� r� r� r Zcompound_returnr9 r9 r: � _calculate_expected_performancev s@ � �689���z0DeepVestProfiler._calculate_expected_performancec � sb �| � |�}ddddd�}g d�}g d�}|jd | �|jd �d �|j|jd690d � ||||d �S )
uK Génère une stratégie de repli lorsque l'analyse LLM n'est pas disponibler� re rL r� r� )z;Diversifier votre portefeuille selon votre profil de risqueuJ Maintenir une épargne de sécurité équivalente à 3-6 mois de dépensesuF Investir régulièrement pour lisser l'exposition au risque de marchéuS Rééquilibrer périodiquement votre portefeuille pour maintenir l'allocation cible)uC Surveiller l'évolution de votre tolérance au risque avec le tempsu^ Ajuster votre stratégie en fonction des changements importants de votre situation personnelleu3 Rester discipliné face aux fluctuations du marchér% r� Nr' )r rK r� r� r� r� r� )r# r �_get_risk_categoryrK r )r8 r� r� r� r� r� r9 r9 r: �_generate_fallback_strategy� s& �691�� �z,DeepVestProfiler._generate_fallback_strategyc C sX |j d }|}d| d }d| d }|dkr&|d }||8 }||||d�S |||d�S ) uB Génère une allocation par défaut basée sur le profil de risquer% rW r� rL r� r� )r) r* r+ zActifs alternatifsr( )r )r8 r� r� r, r- rT � alternativesr9 r9 r: r# � s 692 ��z-DeepVestProfiler._generate_default_allocationc C s4 |dk rdS |dk r dS |dk rdS |dk rdS d S )693u6 Détermine la catégorie de risque basée sur le scorerL r� r� r� r� r� r� r� r� r9 )r8 r� r9 r9 r: r� � s z#DeepVestProfiler._get_risk_categoryc C sf |j }|dkrdddd�}n|dkrdddd�}nd ddd�}|d694 | �|d695 �d �|j|g d �d
�S )u3 Génère une stratégie simplifiée en cas d'erreurr� re rB rL r( r' r� r� r� r% r� )z Diversifier votre portefeuiller' rF )r rK r� r� )r r� rK )r8 r� Z696risk_levelr\ r9 r9 r: �"_generate_simple_fallback_strategy� s ��z3DeepVestProfiler._generate_simple_fallback_strategyrV r� )r� ry rV r )r� r r� ry )r r! rV r )r� r )r� r rV r� )r� r rY ry rV r )rY ry rV r )r� r rV r )r� r� rV r� )r� r r� ry rV r )r� r� rV ry )r� r� rV r� )r� r� rV r� )r� r� rV r� r� )r� rC rK r! r r rV ry )r� r rV ry )r\ rP r� r rV rP )r� ry rV r� )r� r rV r )r\ rP r� r! rV ry )r� r rV rP )r� rC rV r )"r< r= r> r? r� r� r� r� r� r� r� r� r� r� r� r� r� r r� r� r� r� r� r� r� r� r� r� r� r� r� r# r� r r9 r9 r9 r: r� � s@ 697698M69907007017027039704 705 706 707'708 709710 9711t712U713"714)7159716717
7180719)720
r� )0�721__future__r �asyncior@ ru r3 rp r� r� r r r r r � functoolsr �typingr r722 r r r
r r �numpy�npr� r� r r r � ImportErrorr� r r � basicConfig�INFOr4 r[ r rA rn r� r� r r� r� r� r9 r9 r9 r: �<module> sp $ � ��723#NDm h