matthoffner/starchat-ui

Starchat UI

Forked chatbot from forked chatbot-ui.

Slight changes are made to work with a ctransformers API instead of the Llama/OpenAI model.

Using locally

Set OPENAI_API_HOST using an OpenAI API like https://github.com/matthoffner/ggml-fastapi