TheDrainFlorist/data-free-vector-quantization

Data-Free Vector Quantization Beats Affine Quantization at Matched Bytes Below 5 Bits

Version 5, October 2026 (doi:10.5281/zenodo.23147587; all versions: 10.5281/zenodo.22119017). Vector quantization of Qwen3.5-397B-A17B, Qwen3.6-35B-A3B and the dense Qwen3.8-27B, measured against data-free round-to-nearest affine quantization with every other tensor held byte-identical. No calibration data.

The VQ builds measured in the paper are published: https://huggingface.co/TheDrainFlorist