marcorez8/llama-cpp-python-windows-blackwell-cuda

1---2# Model card metadata following Hugging Face specification: 3# https://github.com/huggingface/hub-docs/blob/main/modelcard.md?plain=14# Documentation: https://huggingface.co/docs/hub/model-cards5license: mit6tags:7  - llama-cpp-python8  - cuda9  - nvidia10  - blackwell11  - windows12  - prebuilt-wheels13  - python14  - machine-learning15  - large-language-models16  - gpu-acceleration17---18 19# llama-cpp-python 0.3.9 Prebuilt Wheel with CUDA Support for Windows20 21This repository provides a prebuilt Python wheel for **llama-cpp-python** (version 0.3.9) with NVIDIA CUDA support, for Windows 10/11 (x64) systems. This wheel enables GPU-accelerated inference for large language models (LLMs) using the `llama.cpp` library, simplifying setup by eliminating the need to compile from source. The wheel is compatible with Python 3.10 and supports NVIDIA GPUs, including the latest Blackwell architecture.22 23## Available Wheel24- `llama_cpp_python-0.3.9-cp310-cp310-win_amd64.whl` (Python 3.10, CUDA 12.8)25 26## Compatibility27The prebuilt wheels are designed for NVIDIA Blackwell GPUs but have been tested and confirmed compatible with previous-generation NVIDIA GPUs, including:28- NVIDIA RTX 509029- NVIDIA RTX 309030 31## Installation32To install the wheel, use the following command in your Python 3.10 environment:33 34```bash35pip install llama_cpp_python-0.3.9-cp310-cp310-win_amd64.whl