LiteLLM

LiteLLM

Docker app from joly0's Repository

Overview

LiteLLM provides a proxy server to manage auth, loadbalancing, and spend tracking across 100+ LLMs. All in the OpenAI format.

Requirements

Requires the config.yaml to be placed manually at the volume location
Example can be found here:
https://github.com/BerriAI/litellm/blob/main/proxy_server_config.yaml

Runtime arguments

Web UI
http://[IP]:[PORT:4000]/ui
Network
bridge
Shell
bash
Privileged
false

Template configuration

ConfigPathrw
Target
/app
Default
/mnt/user/appdata/litellm
Value
/mnt/user/appdata/litellm/litellm_config.yaml
API/WebUIPorttcp
Target
4000
Default
4000
Value
4000

Details

Repository
ghcr.io/berriai/litellm:main-latest
Last Updated2026-06-02
First Seen2024-10-02

Run LiteLLM on Unraid.

LiteLLM is listed in Community Apps for Unraid OS. Explore Unraid to build a flexible home server, NAS, or homelab.