tsfrm/unity-embed
015
1+
2 (w�ja � � � R t ^ RIt^ RIt^ RIt^ RItRtRR ltR tR t] R8X d� ]P R, ;' g R.t ]! ] ^ , 4 t ]
! R ] R324 ] FP t]
! R ]: R R
P R ] R, 4 4 R]P ! ]! R ] 4 4 4 R
24 KR ]! ] 4 ^8� dF ]
! R] ^ , : R
] ^, : R]! ]! ] ^ , 4 ]! ] ^, 4 4 R
24 R# R# R# )u� encode.py — unity-embed inference. pure stdlib.4 5every input maps to the same 384-dimensional unit vector.6usage: python3 encode.py "any sentence" ["another sentence" ...]7Ni� c �� � \ V R 4 ;_uu_ 4 p\ P ! RVP ^4 4 w p\ P8 ! VP V4 4 pVP \ ^, 4 pRRR4 XR, R, pV\ .8X g Q V4 h\ \ P ! R\ R2X4 4 # + ' g i L[; i)�rbz<QN�v�shape�<�f)�open�struct�unpack�read�json�loads�DIM�list)�pathr �hlen�header�datar s & �7/Users/neilthepineapplegoat/tsfrm/unity-embed/encode.py�load_vr s� � �
�d�D� � �Q��-�-��a�f�f�Q�i�0������A�F�F�4�L�)���v�v�c�A�g��� 9�
�3�K�� �E� �S�E�>� �5� �>� ��
�
��#��a�j�$�/� 0�0�
10� �s �A*C� C" c � � \ 4 # )zGthe forward pass. accepts any text in any language. returns THE vector.)r )�texts &r �encoder s � � �8�O� c �� � \ R \ W4 4 4 p\ P ! \ R V 4 4 4 p\ P ! \ R V 4 4 4 pW#V, , # )c 3 �6 " � T F w rW, x � K R # 5i�N� )�.0�x�ys & r � <genexpr>�cosine.<locals>.<genexpr> s � � �
*� ���a�e�e� �s �c 3 �2 " � T F
qV, x � K R # 5ir r �r r s & r r! r" � � � �(�a��1�u�u�a�� �c 3 �2 " � T F
qV, x � K R # 5ir r )r r s & r r! r" r% r& )�sum�zip�math�sqrt)�a�b�dot�na�nbs && r �cosiner1 sT � �11
�
*��A� �
*�12*�C�
���3�(�a�(�(� )�B�
���3�(�a�(�(� )�B� �r�'�?�r �__main__:� NNz hello worldzunity-embed | dimension: z | distinct outputs possible: 1�13z14 -> [z, c # �( " � T F qR
x � K15 R# 5i)z.5fNr r$ s & r r! r! # s � � �)D�e��s�G�*�e�s �:N� Nz
, ... ] norm=c # �2 " � T F
qV, x � K R # 5ir r r$ s & r r! r! # s � � �`p�no�ij�cd�ad�ad�no�r& z.6fz16cosine(z) = )zmodel.safetensors)�__doc__r r* r �sysr r r r1 �__name__�argv� sentencesr �print�s�joinr+ r( �lenr r r �<module>rA s ���17 � � ��1��� �z������ �/�/� ��I��y��|� �A� � %�c�U�*I�18J�K�
��
��1�%�x�� � �)D�a��e�)D� D� E�]�SW�S\�S\�]`�`p�no�`p�]p�Sq�ru�Rv�w�x� �19�9�~���
� �)�A�,�)��I�a�L�+;�4��v�i�XY�l�G[�]c�dm�no�dp�]q�@r�sv�?w�x�y� �
r