lemonade-bin

Local LLM server with GPU and NPU acceleration (prebuilt binaries)

Lemonade is a local LLM server that exposes an OpenAI-compatible HTTP API plus a browser UI, and configures state-of-the-art inference engines for the hardware it finds: AMD GPUs (ROCm/Vulkan), NVIDIA GPUs, Intel, Ryzen AI NPUs and plain CPU. It ships a daemon (lemond) and a CLI client (lemonade) able to download, load and route models from providers such as Hugging Face. This package installs upstream's prebuilt "embeddable" binaries instead of building from source. The binaries are taken from the embeddable tarball, which links its Debian-specific dependencies statically; the official .deb is used only as a source of architecture-independent data (web UI, JSON resources, schemas, examples, man pages and systemd units), because its executables require Debian-13 library sonames that do not exist on Gentoo. Inference backends are not packaged: lemond downloads them at runtime into its cache directory.

homepage ↗homepage ↗ github: lemonade-sdk/lemonade