habedi/multi-vector-hnsw-datasets

Multi-Vector HNSW Benchmark Datasets

This repository contains benchmark datasets used by the Multi-Vector HNSW project. The datasets are from habedi/multi-vector-search-datasets. Each record includes a question ID and three distinct 768-dimensional vectors representing the title, body, and tags of the question. The text embeddings were generated using the all-mpnet-base-v2 text embedding model.

There are three datasets; each includes questions from a separate Q\&A community hosted on Stack Exchange. Each dataset consists of three files:

• —train.json: The data used to build the index.
• —test.json: The query data used for searching the index.
• —neighbours.json: The ground truth, containing the actual k=100 nearest neighbors for each item in test.json.