juiceb0xc0de/llama-cpp-cuda12-ada89

llama.cpp CUDA 12.8.1, target GPU: sm89 If you're new or just starting to learn setting up your own inferences this llama.cpp wheel will work for if you're using python, CUDA 12.8.1 with one of the following Ada Lovelace generation (sm_89) GPU's: NVIDIA L4 NVIDIA L40 NVIDIA L40S NVIDIA RTX 6000 Ada Generation NVIDIA RTX 5000 Ada Generation NVIDIA RTX 4500 Ada Generation NVIDIA RTX 4000 Ada Generation NVIDIA RTX 4000 SFF Ada Generation NVIDIA RTX 2000 Ada Generation NVIDIA GeForce RTX 4090… See the full description on the dataset page: https://huggingface.co/datasets/juiceb0xc0de/llama-cpp-cuda12-ada89.