vLLM

vLLM

Official

Docker app from m0ngr31's Repository

Overview

Easy, fast, and cheap LLM serving for everyone

Install vLLM on Unraid in a few clicks.

Find vLLM in Community Apps on your Unraid server, review the template, and click Install. Unraid handles the Docker app or plugin setup from the published template.

Open the Apps tab on your Unraid server Search Community Apps for vLLM Review the template variables and paths Click Install
Explore Unraid OS

Requirements

Nvidia Driver plugin (nVidia Support)

Categories

AI

Download Statistics

26,006,151
Total Downloads
2,605,096
This Month
2,513,819
Avg / Month

Total Downloads Over Time

Loading chart...

Related apps

Explore more like this

Explore all
AI

Links

Projectdocs.vllm.aiSupportdiscord.ggDocker Hubhub.docker.comTemplateraw.githubusercontent.com

Details

Repository
vllm/vllm-openai
Registry
https://hub.docker.com/r/vllm/vllm-openai
Last Updated2026-06-30
First Seen2024-11-15

Runtime arguments

Web UI
http://[IP]:[PORT:8000]/
Shell
sh
Privileged
false
Extra Params
--runtime=nvidia --ipc=host

Template configuration

NVIDIA_VISIBLE_DEVICESVariable
Default
all
Value
all
NVIDIA_DRIVER_CAPABILITIESVariable
Default
all
Value
all
Model StoragePathrw
Target
/root/.cache/huggingface
Default
/mnt/user/appdata/vllm
Value
/mnt/user/appdata/vllm
PortPorttcp
Target
8000
Default
8000
Value
8000
Hugging Face TokenVariable
Target
HUGGING_FACE_HUB_TOKEN