CLSDNZ/server.cpp

1---2title: server.cpp / Ghudsavar3emoji: 🏇🏻4colorFrom: gray5colorTo: green6sdk: docker7pinned: false8license: mit9app_port: 786010short_description: Phi-3-Mini on llama.cpp based server 11---12 13# Server.cpp / Ghudsavar 🏇🏻 14 15Github [iAkashPaul/Ghudsavar](https://github.com/iakashpaul/Ghudsavar)16 17> Ghudsavar (Horse rider) - a quick server image, with one click deployment to HuggingFace spaces (even on the free tier with 2 CPU-cores).18 19Try it here [iAkashPaul/server.cpp](https://iakashpaul-server-cpp.hf.space) (default HF Space Embed messes up the themeing).20 21```Phi3-mini``` @Q4 runs at ~5tok/s22 23## Customize yours 24 25```bash26git clone https://github.com/iakashpaul/Ghudsavar.git27docker build -t iakashpaul/server.cpp:latest . --platform linux/amd6428```