Team Ai
Modelpublic

bjivanovich/swift-1.5-27b-coding-GGUF

sourceHugging Faceapache-2.0updated 6d agoView on Hugging Face
0likes390downloads
Model Card

swift-1.5-27b-coding-GGUF

Official GGUF quantized weights for [swift-1.5-27b-coding](https://huggingface.co/ajgazin/Swift-1.5-Qwen3.8-27B-Uncensored-MTP), a specialized 27B parameter coding model fine-tuned using DoRA on bjivanovich/code-py-rust-cpp-50k (covering Python, Rust, C++, and multi-step reasoning).

All quantizations were generated using an importance matrix (imatrix) calibrated directly on domain-specific programming samples.

Quantization Details

File NameQuant MethodApprox SizeRecommended Use Case
swift-1.5-27b-coding-Q4_K_M.ggufQ4KM (imatrix)16.8 GBOptimal balance of speed, size, and reasoning quality (fits in 24GB GPUs).
swift-1.5-27b-coding-Q5_K_M.ggufQ5KM (imatrix)19.5 GBHigh fidelity; preserves subtle syntax nuances.
swift-1.5-27b-coding-Q6_K.ggufQ6_K (imatrix)22.4 GBNear-lossless precision.
swift-1.5-27b-coding-Q8_0.ggufQ8_029.0 GBReference standard precision.
mmproj-BF16.ggufBF160.9 GBVision projector, needed only for image and video input.
swift-27b-coding.imatrixImportance Matrix13.6 MBCalibration data used for quantized layers.

Training & Specialization

  • —Base Architecture: 27B Parameters
  • —Technique: DoRA (Weight-Decomposed Low-Rank Adaptation)
  • —Dataset: bjivanovich/code-py-rust-cpp-50k (50,000 samples)
  • —Python: 59.0%
  • —C++: 20.4%
  • —Rust: 15.5%
  • —Reasoning: 5.0%

Prompt Template (ChatML)

text
<|im_start|>user
Write a thread-safe generic queue in Rust using Arc and Mutex with unit tests.<|im_end|>
<|im_start|>assistant