dylanebert/multi-view-diffusion
64
1o
2 � f� � @ s� d dl Zd dlZd dlmZ d dlmZ ejddejdd�� d�Z3ejd dejdd�� d�Z d4d � Z d d
� Z
dd� Ze�� ��Ze�� �� e�� �S e�d�� ejdddd�Ze�d�ZW d � n1 sfw Y e�d�� ejddd�Zejdddd�Ze�d�ZW d � n1 s�w Y W d � n1 s�w Y e�� � ejdd�ZW d � n1 s�w Y W d � n1 s�w Y ej e
eed � ej eeeged � W d � n1 s�w Y e d kr�e� � dS dS ) � N)�DiffusionPipeline)�Imagez ashawkey/mvdream-sd2.1-diffusersz dylanebert/multi_view_diffusionT)�custom_pipeline� torch_dtype�trust_remote_code�cudaz"ashawkey/imagedream-ipmv-diffusersc C s� dd� | D �} | d j \}}t�dd| d| f�}|�| d d� |�| d |df� |�| d d|f� |�| d ||f� |S ) Nc S s g | ] }t �|d �d���qS )�� �uint8)r � fromarray�astype)�.0�img� r �)/home/dylan/mvdream_test/text_pipeline.py�5<listcomp> s z%create_image_grid.<locals>.<listcomp>r �RGB� )r r � � )�sizer �new�paste)�images�width�height�grid_imgr r r �create_image_grid s r c C s t | dddd�}t|�S )N� � r ��guidance_scale�num_inference_steps� elevation)�
text_pipeliner )�promptr r r r �6text_to_mv& s �r% c C s( | � d�d } t|| dddd�}t|�S )N�float32g �o@r r r r )r �image_pipeliner )�imager$ r r r r � image_to_mv- s7 8�r) z9Text Inputr Fz.Enter a text prompt here (e.g. 'a cat statue'))�lines�10show_label� placeholderzGenerate Multi-View Imagesz Image Input�numpy)�label�typez"Enter an optional text prompt herezGenerated Images)r. )�fn�inputs�outputs�__main__) �gradio�gr�torch� diffusersr �PILr �from_pretrained�float16�tor# r' r r% r) �Blocks�demo�Row�Column�Tab�Textbox�11text_input�Button�text_btn� image_input�optional_text_input� image_btn�output�click�__name__�launchr r r r �<module> sz ����121314 � � �� �� �15 �� �16� � �