CohereLabs/BinaryVectorDB

Pre-build Binary Vector Databases Here we ship different pre-build Binary Vector databases. See the Github readme what Binary Vector Database is and why it can save you a lot of memory (and money) when you need to scale to tens or hundred millions of embeddings. Available Datasets We have Wikipedia available in all 300+ languages. See Files for the different files. These are simple .zip files you can download and unzip locally. Note for the English Wikipedia:… See the full description on the dataset page: https://huggingface.co/datasets/CohereLabs/BinaryVectorDB.