koboldcpp
koboldcpp
Docker app from oromis95's Repository
Overview
KoboldCpp is a lightweight but powerful AI backend, bundled with KoboldAI Lite frontend.
https://hub.docker.com/r/koboldai/koboldcpp/
Runtime arguments
- Web UI
http://[IP]:[PORT:5001]/- Network
bridge- Shell
bash- Privileged
- false
- Extra Params
--gpus all
Template configuration
Don't Remote TunnelVariable
- Target
- KCPP_DONT_TUNNEL
- Default
- true
- Value
- true
WorkspacePathrw
This is where your docker data will be stored. Models and binaries will be saved here.
- Target
- /workspace
KCPP_ARGSVariable
This is where we add run variables. '--model' accepts URL's and filenames.
- Default
- --model https://huggingface.co/concedo/KobbleTinyV2-1.1B-GGUF/resolve/main/KobbleTiny-Q4_K.gguf
- Value
- --model https://huggingface.co/concedo/KobbleTinyV2-1.1B-GGUF/resolve/main/KobbleTiny-Q4_K.gguf
WebUI PortPorttcp
- Target
- 5001
- Default
- 5002
- Value
- 5002
Don't Update Kobold on LaunchVariable
The Docker container update is a separate update. This just updates the binary.
- Target
- KCPP_DONT_UPDATE
- Default
- false
- Value
- false
Retain Models on RestartVariable
- Target
- KCPP_DONT_REMOVE_MODELS
- Default
- true
- Value
- true
Categories
Download Statistics
112,230
Total Downloads
6,163
This Month
6,101
Avg / Month
Total Downloads Over Time
Loading chart...
Details
Repository
koboldai/koboldcppLast Updated2026-05-06
First Seen2025-03-03
Run Koboldcpp on Unraid.
Koboldcpp is listed in Community Apps for Unraid OS. Explore Unraid to build a flexible home server, NAS, or homelab.