Team Ai
Modelpublic

pdelobelle/DeepSeek-R1-GGUF-MTP

sourceHugging Facemitupdated 2y agoView on Hugging Face
2likes61downloads
Model Card

Quantized MTP head of Deepseek R1. For use with the Unsloth's Q4_K quants.

Llama.cpp does not support MTP heads, but vLLM does.