Team Ai
Modelpublic

aitytech/Whisper-Small-MLX-FP16

sourceHugging Faceapache-2.0updated 7mo agoView on Hugging Face
0likes26downloads
Model Card

Whisper Small - MLX FP16

This is the OpenAI Whisper Small model converted to MLX format with FP16 precision, optimized for Apple Silicon inference.

Model Details

PropertyValue
Base Modelopenai/whisper-small
Parameters~244M
FormatMLX SafeTensors (FP16)
Model Size458.92 MB
Sample Rate16,000 Hz
Audio Layers12
Text Layers12
Hidden Size768
Attention Heads12
Vocabulary Size51,865

Intended Use

This model is optimized for on-device automatic speech recognition (ASR) on Apple Silicon devices (Mac, iPhone, iPad). It is designed for use with the WhisperKit or MLX frameworks.

Files

  • —config.json - Model configuration
  • —model.safetensors - Model weights in SafeTensors format (FP16)
  • —multilingual.tiktoken - Tokenizer

Usage

python
import mlx_whisper

result = mlx_whisper.transcribe(
    "audio.mp3",
    path_or_hf_repo="aitytech/Whisper-Small-MLX-FP16",
)
print(result["text"])

Original Model