Team Ai
Modelpublic

OsaurusAI/MiniMax-M3-Coder-Small

sourceHugging Faceotherupdated 4mo agoView on Hugging Face
6likes328downloads
Model Card

<p align="center"><img src="./osaurus-banner.png" alt="Osaurus" width="680"></p> <h1 align="center">MiniMax-M3-Coder-Small</h1> <p align="center"><b>๐Ÿฆ– Osaurus Exclusive โ€” a compact JANG-quantized MiniMax-M3 coder (coding ยท agentic ยท multimodal) for Apple Silicon.</b></p>

โš ๏ธ JANG-format model โ€” runs on Osaurus. This uses the JANG quantization format (mixed-precision affine + AWQ + REAP expert pruning) and loads through Osaurus's native Swift runtime. It will NOT load with transformers, vLLM, or generic MLX loaders.

What is a JANG model?

JANG is a mixed-precision quantization + packing format โ€” per-projection affine bit widths + AWQ activation-aware scaling + REAP expert pruning โ€” described by a jang_config.json. Weights stay quantized in GPU memory. Osaurus loads it through its native Swift JANG runtime on Apple Silicon.

Highlights

  • โ€”Smallest M3 coder โ€” ~84 GB (the compact Osaurus build).
  • โ€”REAP45: keep 70/128 routed experts (45% pruned).
  • โ€”All-2-bit routed experts + AWQ (gate/up 2-bit AWQ-scaled, down 2-bit); attention 8-bit, shared experts 6-bit, embeddings 6-bit, lm_head 8-bit, Lightning Indexer FP16.
  • โ€”Multimodal (vision) kept.
  • โ€”Calibration: Vera (agentic-coder) + GSM8K; "floor" recipe keeps the most-salient coding experts.

Benchmarks

  • โ€”HumanEval: pass@1 = 100% (82/82, scrambled-half adaptive eval, seed 42; 0 failures, 0 escalations).
  • โ€”Despite 45% expert pruning + all-2-bit routed experts, coding accuracy holds at 100% โ€” the REAP45 keep-set is a subset of the larger M3-Coder builds' proven coding experts, so coding capability is preserved while the model shrinks to ~84 GB.

Run it

Load it in Osaurus (Apple Silicon) โ€” it runs on Osaurus's native Swift JANG runtime.

Attribution

  • โ€”Base model: MiniMaxAI/MiniMax-M3 ยท Pruning: REAP (Cerebras, arXiv:2510.13999)
  • โ€”Vera calibration + testing: [@hornsman1](https://huggingface.co/hornsman1) (hornsan1 on GitHub) ยท math calibration: GSM8K
  • โ€”Quantization: JANG ยท Runtime & distribution: Osaurus