Apppublic

CLSDNZ/server.cpp

sourceHugging Facemitupdated 2y agoView on Hugging Face

0likes

App README

Server.cpp / Ghudsavar 🏇🏻

Ghudsavar (Horse rider) - a quick server image, with one click deployment to HuggingFace spaces (even on the free tier with 2 CPU-cores).

Try it here iAkashPaul/server.cpp (default HF Space Embed messes up the themeing).

Phi3-mini``` @Q4 runs at ~5tok/s


## Customize yours

git clone https://github.com/iakashpaul/Ghudsavar.git docker build -t iakashpaul/server.cpp:latest . --platform linux/amd64