models
Open weights, fine-tunes and adapters. Every listing here comes live from the Hugging Face Hub, attributed to it, and links back to the source.
gemma-3-27b-it-quantized.w4a16gemma-3-12b-it-quantized-W4A16Qwen3-VL-8B-Instruct-quantized.w4a16Qwen3.5-9B-quantized.w8a8Meta-Llama-3.1-8B-Instruct-quantized.w4a16Qwen3.5-9B-quantized.w4a16Qwen3-30B-A3B-Instruct-2507-quantized.w4a16Qwen2.5-VL-3B-Instruct-quantized.w8a8DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16Qwen2.5-VL-7B-Instruct-quantized.w8a8granite-3.1-2b-instruct-quantized.w4a16Meta-Llama-3.1-8B-Instruct-quantized.w8a8gemma-3-27b-it-quantized-W4A16Meta-Llama-3.1-70B-Instruct-quantized.w4a16Qwen3-8B-quantized.w4a16Qwen3-0.6B-quantized.w4a16Qwen3.5-4B-quantized.w4a16gemma-3-12b-it-quantized.w4a16Meta-Llama-3.1-8B-quantized.w8a8Qwen3-32B-quantized.w4a16Qwen3-4B-quantized.w4a16gemma-3-4b-it-quantized.w4a16Qwen3-30B-A3B-Instruct-2507-quantized.w8a8Qwen3.5-35B-A3B-quantized.w4a16gemma-3-4b-it-quantized.w8a8stsb-bert-tiny-openvino-quantized-onlyQwen3.5-4B-quantized.w8a8MiniCPM5-2B-RotSVDMix-QuantizedQwen3-30B-A3B-quantized.w4a16Qwen3.5-27B-quantized.w4a16