serge

A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

What gets deployed

Web

serge server

GitHub stars5,732

About

A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

One click to deploy a fully configured serge instance with all dependencies pre-wired.

No infrastructure to manage. Just connect your repo and go live in seconds.