David310/Detect_AI-generated_Image
4
1U
2 ��^f� � @ sT d dl Z d dlZd dlmZ d dlmZmZ d dlZd dlm Z G dd� de�Z3dS )� N)� BaseModel� init_weights)� get_modelc sN e Zd Zdd� Z� fdd�Zddd�Zdd � Zd4d � Zd d
� Zdd� Z � Z5S )�Trainerc C s dS )Nr � ��selfr r �8/root/autodl-tmp/UniversalFakeDetect/networks/trainer.py�name s z Trainer.namec s t t| ��|� || _t|j�| _tjj �6| jj j j
d|j� |jr�g }| j�� D ]*\}}|dksj|dkrv|�|� qRd|_qRn$td� dd l}|�d� | j�� }|jdkr�tjj||j|jd f|jd7�| _ n.|jd kr�tjj ||jd|jd �| _ nt d
��t� � | _ | j�!|j"d � d S )Ng z fc.weightzfc.biasFz�Your backbone is not fixed. Are you sure you want to proceed? If this is a mistake, enable the --fix_backbone command during training and rerunr � �adamg+�����?)�lr�betas� weight_decay�sgd)r
�momentumr zoptim should be [adam, sgd])#�superr �__init__�optr �arch�model�torch�nn�init�normal_�fc�weight�dataZ init_gainZ fix_backbone�named_parameters�append�
requires_grad�print�time�sleep�8parameters�optim�AdamWr
�beta1r � optimizer�SGD�9ValueError�BCEWithLogitsLoss�loss_fn�toZgpu_ids)r r �paramsr10 �pr" �� __class__r r r s* 11121314"15 16zTrainer.__init__�����ư>c C s4 | j jD ]&}|d d < |d |k r dS qdS )Nr
g $@FT)r( � param_groups)r �min_lr� param_groupr r r �adjust_learning_rate- s17 z Trainer.adjust_learning_ratec C s, |d � | j�| _|d � | j��� | _d S )Nr � )r- �device�input�float�label)r r9 r r r � set_input5 s zTrainer.set_inputc C s& | � | j�| _| j�d��d�| _d S )N�����r7 )r r9 �output�view� unsqueezer r r r �forward: s zTrainer.forwardc C s | � | j�d�| j�S �Nr7 )r, r> �squeezer; r r r r �get_loss? s zTrainer.get_lossc C sB | � � | �| j�d�| j�| _| j�� | j�� | j� � d S rB )18rA r, r> rC r; �lossr( � zero_grad�backward�stepr r r r �optimize_parametersB s19 2021zTrainer.optimize_parameters)r2 ) �__name__�22__module__� __qualname__r23 r r6 r< rA rD rI �
__classcell__r r r0 r r s !24r ) � functoolsr �torch.nnr Znetworks.base_modelr r �sys�modelsr r r r r r �<module> s