LeroyDyer/SpydazWebAI_VisionEncoderDecoderModel_Mini3b

1---2language:3- en4library_name: transformers5pipeline_tag: image-text-to-text6tags:7- vision8---9# ADD HEAD10 11```12 13 14 15print('Add Vision...')16# ADD HEAD17# Combine pre-trained encoder and pre-trained decoder to form a Seq2Seq model18 19 20 21Vmodel = VisionEncoderDecoderModel.from_encoder_decoder_pretrained(22    "google/vit-base-patch16-224-in21k", "LeroyDyer/Mixtral_AI_Tiny"23)24_Encoder_ImageProcessor = Vmodel.encoder25_Decoder_ImageTokenizer = Vmodel.decoder26_VisionEncoderDecoderModel = Vmodel27# Add Pad tokems28LM_MODEL.VisionEncoderDecoder = _VisionEncoderDecoderModel29# Add Sub Components30LM_MODEL.Encoder_ImageProcessor = _Encoder_ImageProcessor31LM_MODEL.Decoder_ImageTokenizer = _Decoder_ImageTokenizer32LM_MODEL33 34 35```