Circuits-V2/antimatter

[image]

Entropy the size of a positron

Incredibly small 3 expert Mixture of Experts trained to be decent in coding, math, and generic conversation. I'm still training it :'D

I suggest using BeeLlama.cpp for squeezing as much performance as possible out of this thing :]

This model will include an mmproj to try to have basic image support using the frozen embeddings of wkcn/TinyCLIP-ViT-8M-16-Text-3M-YFCC15M.