Serge - LLaMa made easy A chat interface based on llama.cpp for running Alpaca models. Entirely self-hosted, no API keys needed. Fits on 4GB of RAM (depending on model) and runs on the CPU. Models can be downloaded from within the interface. A note on memory usage: llama will just crash if you don't have enough available memory for your model. 7B requires about 4.5GB of free RAM 13B requires about 12GB free 30B requires about 20GB free New models are regularly being added, check the project page for notes and requirements